{"id":36249,"date":"2024-11-01T09:47:00","date_gmt":"2024-11-01T09:47:00","guid":{"rendered":"http:\/\/atmokpo.com\/w\/?p=36249"},"modified":"2024-11-01T09:47:00","modified_gmt":"2024-11-01T09:47:00","slug":"huggingface-transformers-tutorial-pfizer-covid-19-wikipedia-text-retrieval","status":"publish","type":"post","link":"https:\/\/atmokpo.com\/w\/36249\/","title":{"rendered":"huggingface transformers tutorial, Pfizer COVID-19 Wikipedia text retrieval"},"content":{"rendered":"

<\/p>\n

Fetching Pfizer COVID-19 Wikipedia Text<\/h2>\n

In this course, we will learn how to fetch COVID-19 related information about Pfizer from Wikipedia using the Hugging Face Transformers library. This course is aimed at those who have a basic knowledge of natural language processing (NLP) and will guide you on how to comfortably use Hugging Face’s library with Python as a friend.<\/p>\n

1. Environment Setup<\/h2>\n

First, we need to install the necessary libraries. Enter the code below to install transformers<\/code> and wikipedia-api<\/code>.<\/p>\n

!pip install transformers wikipedia-api<\/code><\/pre>\n
2. Importing Libraries<\/h2>\n
Let’s import the necessary libraries. transformers<\/code> helps in easily using natural language processing models. wikipedia-api<\/code> allows easy access to the Wikipedia API.<\/p>\n
import wikipediaapi\nfrom transformers import pipeline<\/code><\/pre>\n
3. Fetching Information from Wikipedia<\/h2>\n
Now, let’s fetch COVID-19 and Pfizer-related information from Wikipedia. We will use wikipediaapi<\/code> to get the information.<\/p>\n
wiki_wiki = wikipediaapi.Wikipedia('en')\npage = wiki_wiki.page(\"COVID-19_vaccine_Pfizer\") \n\nif page.exists():\n    print(page.text[0:1000])  # Print the first 1000 characters\nelse:\n    print(\"The page does not exist.\") <\/code><\/pre>\n
Code Explanation<\/h3>\n
The above code retrieves the “COVID-19 Vaccine Pfizer” page from Wikipedia. If the page exists, it prints the first 1000 characters. This helps us verify the content of the information we want to fetch.<\/p>\n
4. Summarizing the Text<\/h2>\n
Since the fetched data contains many long sentences, let’s summarize it using a natural language processing model. We will use the summarization model provided by the Hugging Face transformers<\/code> library.<\/p>\n
summarizer = pipeline(\"summarization\")\n\nsummary = summarizer(page.text, max_length=130, min_length=30, do_sample=False)\n\nprint(\"Summary:\")\nfor s in summary:\n    print(s['summary_text'])<\/code><\/pre>\n
Code Explanation<\/h3>\n
This code performs text summarization through the Hugging Face “summarization” pipeline. You can adjust the length of the summary by setting max_length<\/code> and min_length<\/code>.<\/p>\n
5. Conclusion<\/h2>\n
In this course, we learned how to fetch and summarize Pfizer’s COVID-19 information using Hugging Face Transformers and the Wikipedia API. We hope you have glimpsed the possibilities of natural language processing. These techniques can be applied in various fields and are useful tools for your projects.<\/p>\n
6. Next Steps<\/h2>\n
Furthermore, try various natural language processing tasks such as sentiment analysis, question-answering systems, and document classification! We recommend exploring Hugging Face’s model hub to find and utilize models that suit you.<\/p>\n
\nReferences:<\/strong><\/p>\n