python - problem scraping with BeautifulSoup -


i trying scrape url http://www.kat.ph/search/beatles/?categories[]=music using beautifulsoup 

torrents = bs.findall('tr',id = re.compile('torrent_*'))

torrents gets torrents on page ,now every element of torrents contains tr element.

my problem len(torrents[0].td) 5 not able iterate on td's.i mean for x in torrents[o].td not working.

the data getting torrent[0] : 

<tr class="odd" id="torrent_2962816"> <td class="fontsize12px torrentnamecell"> <div class="iaconbox floatedright"> <a title="torrent magnet link" href="magnet:?xt=urn:btih:0898a4b562c1098eb69b9b801c61a51d788df0f5&amp;dn=the+beatles+2009+greatest+hits+cdrip+ikmn+reupld&amp;tr=http%3a%2f%2ftracker.publicbt.com%2fannounce" onclick="_gaq.push(['_trackevent', 'download', 'magnet link', 'music']);" class="imagnet icon16"></a> <a title="download torrent file" href="http://torrage.com/torrent/0898a4b562c1098eb69b9b801c61a51d788df0f5.torrent?title=[kat.ph]the.beatles.2009.greatest.hits.cdrip.ikmn.reupld" onclick="_gaq.push(['_trackevent', 'download', 'download torrent file', 'music']);" class="idownload icon16"></a> <a class="ipartner2 icon16" href="http://www.downloadweb.org/checking.php?acode=b146a357c57fddd450f6b5c446108672&amp;r=d&amp;qb=vghliejlyxrszxmgwziwmdldiedyzwf0zxn0iehpdhmgq0rsaxatiglltu4gumvvugxk" onclick="_gaq.push(['_trackevent', 'download', 'download movie']);"></a> <a class="iverif icon16" href="/the-beatles-2009-greatest-hits-cdrip-ikmn-reupld-t2962816.html" title="verified torrent"></a> <a rel="2962816,0" class="icomment" href="/the-beatles-2009-greatest-hits-cdrip-ikmn-reupld-t2962816.html#comments_tab"> <span class="icommentdiv"></span>145     </a> </div> <div class="torrentname"> <a href="/the-beatles-2009-greatest-hits-cdrip-ikmn-reupld-t2962816.html" class="tortype musictype"></a> <a href="/the-beatles-2009-greatest-hits-cdrip-ikmn-reupld-t2962816.html">the <strong class="red">beatles</strong> [2009] greatest hits cdrip- ikmn reupld</a> <span>                 posted <a class="plain" href="/user/ikmn/">ikmn</a> <img src="http://static.kat.ph/images/verifup.png" alt="verified" /> in                      <span id="cat_2962816"> <a href="/music/">music</a> </span></span> </div> </td> <td class="nobr">168.26 <span>mb</span></td> <td>42</td> <td>1&nbsp;year</td> <td class="green">1368</td> <td class="red lasttd">94</td> </tr>

i'd recommend using lxml or instead of beautifulsoup, among other great features can use xpath grab links:

import lxml.html doc = lxml.html.parse('http://www.kat.ph/search/beatles/?categories[]=music') links = doc.xpath('//a[contains(@class,"idownload")]/@href')

Comments

Post a Comment

Popular posts from this blog

c++ - Is it possible to compile a VST on linux? -

for class project i'm attempting write vst plugin backed cuda. current cuda workflow on linux box, i'd prefer compile , link there. according wikipedia , should possible (i couldn't find steinberg documentation relevant linux) can't find makefile or instructions on how build if aren't using xcode or visual studio. i'm vst 3 sdk doesn't support linux. when try compile plugin under linux, error: ./base/source/fatomic.cpp:39:30: fatal error: libkern/osatomic.h: no such file or directory this issue caused following code in "vst3 sdk/base/source/fatomic.cpp" #if mac #include <libkern/osatomic.h> #if mac_os_x_version_min_required > mac_os_x_version_10_4 #define native_atomic_type (volatile int32_t*) #else #define native_atomic_type (int32_t*) #endif #elif windows #include <windows.h> #endif but hope compiling under linux work vst sdk 2.4. reading. jvstwrapper seems run on lin...
Read more

java - Output of Eclipse is rubbish -

i want write program in eclipse language different english. when display output using system.out program, displays output correctly in console editor. when accept input console , output it, output rubbish. how can solve it. many thnaks i'm not sure if problem, have character encoding problem. make sure you're using unicode, utf-8. you can read more @ official docs converting non-unicode text .
Read more

jquery - Confused with JSON data and normal data in Django ajax request -

i read json internet still have not got grasp of it. reading article http://webcloud.se/log/ajax-in-django-with-jquery/ i not understood first part function using json def xhr_test(request, format): if request.is_ajax(): if format == 'xml': mimetype = 'application/xml' if format == 'json': mimetype = 'application/javascript' data = serializers.serialize(format, examplemodel.objects.all()) return httpresponse(data,mimetype) # if want prevent non xhr calls else: return httpresponse(status=400) my main problems are from function getting format variable does format json mean data given function json or data recived json can give me simple example ouput of function data = serializers.serialize(format, examplemodel.objects.all()) how use data when response in jquery function if don't use json in above function how input , response chnage thanks ...
Read more