python - get text content from p tag -

-

i trying description text content of each block on page

https://twitter.com/search?q=data%20mining&src=typd&vertical=default&f=users.

html p tag looks like

<p class="profilecard-bio u-dir" dir="ltr" data-aria-label-part=""><a href="http://t.co/kwtdyfn6dc" rel="nofollow" dir="ltr" data-expanded-url="http://dataminingblog.com" class="twitter-timeline-link" target="_blank" title="http://dataminingblog.com"><span class="invisible">http://</span><span class="js-display-url">dataminingblog.com</span><span class="tco-ellipsis"><span class="invisible">&nbsp;</span></span></a> covers current challenges, interviews leading actors , book reviews related data mining, analytics , data science.</p>

my code:

productdivs = soup.findall('div', attrs={'class' : 'profilecard-content'}) div in productdivs:    print div.find('p', attrs={'class' : 'profilecard-bio u-dir'}).text

anything wrong here? getting exception here

traceback (most recent call last):   file "twitter_user_scrapper.py", line 91, in getimagelist     print div.find('p', attrs={'class' : 'profilecard-bio u-dir'}).text attributeerror: 'nonetype' object has no attribute 'text'

the issue might div class profilecard-content may not have child p element class - profilecard-bio u-dir , when happens , following returns none -

div.find('p', attrs={'class' : ['profilecard-bio', 'u-dir']})

and reason getting attributeerror. should return of above , save in variable , , check whether none or not , take text if not none.

also, should give class list of classes , not single string, -

attrs={'class' : ['profilecard-bio', 'u-dir']}

example -

productdivs = soup.findall('div', attrs={'class' : 'profilecard-content'}) div in productdivs:    elem = div.find('p', attrs={'class' : ['profilecard-bio', 'u-dir']})    if elem:        print elem.text

Comments

Post a Comment

Popular posts from this blog

qt - Using float or double for own QML classes -

-
i've created components , helper methods using c++ , qt used in qml gui. of methods calculate gui elements (size, transformations, scene graph items creation). target arm 32 bit using opengl / eglfs render output. opengl using float , qml using real (defined double ). what should use in c++ do not lose precision? if use qreal ( double ) shouldn't lose precision. if git grep float in qtbase.git , can find out bit more: dist/changes-5.2.0-**************************************************************************** dist/changes-5.2.0-* important behavior changes * dist/changes-5.2.0-**************************************************************************** dist/changes-5.2.0- dist/changes-5.2.0- - qt compiled qreal typedef'ed double on dist/changes-5.2.0: platforms. qreal float on arm chipsets before. guarantees more dist/changes-5.2.0- consistent behavior between platforms qt supports, binary dist/chan...
Read more

Create Outlook appointment via C# .Net -

-
i need create outlook appointment using microsoft.office.interop.outlook , while can work locally on own workstation , works if run web application via server's browser, not work when connect server externally. hence, think might permission issue. i changed application pool identity " localsystem " don't access denied error. unfortunately, doesn't work. the app behaves if appointment created, appointment doesn't appear in outlook. here include file on top of aspx.cs page using outlook = microsoft.office.interop.outlook; here code using pop appointment. outlook.application apptapp = new outlook.application(); outlook.appointmentitem appt = apptapp.createitem(outlook.olitemtype.olappointmentitem) outlook.appointmentitem; appt.subject = txtfirstname.text + " " + txtlastname.text; appt.body = txtcomment.text; appt.alldayevent = false; appt.start = datetime.parse(txtreminderdate.text + " 8:00 am"); appt.end = datetime.p...
Read more

ios - Swift Array Resetting Itself -

-
i have 2 arrays: pointhistory , datehistory . have nstimer , , when timer runs out, action called. in action appending int pointhistory , , current date string datehistory . here timer action: func timeraction() { let steppervalue = int(stepper.value) employee.numberofpoints = steppervalue networking.saveemployee(employee, completion: { (error) -> void in if error != nil { let alert = uialertcontroller(title: "error", message: "there error updating \(self.employee.name)'s points", preferredstyle: .alert) let alertaction = uialertaction(title: "ok", style: .cancel, handler: nil) alert.addaction(alertaction) self.presentviewcontroller(alert, animated: true, completion: nil) } }) var dateformatter = nsdateformatter() dateformatter.dateformat = "mm-dd-yyyy" dateformatter.timezone = nstimezone.localtimezone() var date = nsdate() var ...
Read more