We then pass this function to the find_all() method to get the desired output. The function returns True in case of a match, otherwise it returns False.Įxample: The following code defines a function which returns True for all classes that also have an id in the HTML document. We can define a function and pass an element as its argument. Multiple tags can be passed into the search functions using a list a shown in the example below:Įxample: The following code finds all the and tags in the HTML document. # finding regular expressionsįor regular in soup.find_all(re.compile('^b')): name attribute.Įxample: The following code finds all instances of the tags starting with the letter “b”. To get just the name of the tag instead of the entire content (tag+ content within the tag), use the.We need to import the re module to use a regular expression.In case you want to master the concepts of the regex module in Python, please refer to our tutorial here. Passing a regular expression object allows Beautiful Soup to filter results according to that regular expression. Let us have a look at an example and find the tags in the HTML document: print(soup.find_all('h1')) When we pass a string to a search method then Beautiful Soup performs a match against that passed string. These filters can be used based on the tags: There are different filters that can be passed into the find() and find_all() methods and it is crucial to have a clear understanding of these filters as they are used again and again, throughout the search mechanism. Soup = BeautifulSoup(html_doc, 'html.parser') Types Of Filters

? The following Example will be used throughout this document while demonstrating the concepts: html_doc = ''' Therefore, we will be focusing on the find() and find_all() methods in this article. The other methods are quite similar in terms of their usage. The two most popular and commonly methods are: Now, how do we find the right tags? We can do so with the help of BeautifulSoup's search methods.īeautiful Soup has numerous methods for searching a parse tree. Thus we need to find the right tags to extract what we need. HTML (Hypertext Markup Language) consists of numerous tags and the data we need to extract lies inside those tags.

Dtsearch parse tree