How to get all anchor tags using BeautifulSoup

Question

Hi. I am web scraping and I am trying to find all the anchor tags in the page. I am using the following:

for link in soup.find(‘a’):
   print (a.text)

But some times the loop fails. Is there any other way to do it?

Answer 1

Yes, you can do it by using the default option by BeautifulSoup.

Try this:

for tag in soup.find_all('a'):
    print (tag.text)

Comments

use 'href' instead of text