Web Scraping : Velodyne LIDAR
Web Scraping :
Velodyne LIDAR
Project overview
The goal of the internship was to scrape data from dynamic website
The website contains data from the lidar sensors shown in real time
Tags: python , Linux , webdriver , selenium
Hardware Supplies :
Velodyne LIDAR : ' PUCK ' : (Compact, Powerful, Intelligent)Velodyne’s Puck lidar sensor (previously VLP-16) is the highest-value sensor on the market. The Puck™’s reliability, power efficiency, and surround view make it the ideal solution for affordable low-speed autonomy and driver assistance applications
What is Web Scraping?
Web scraping (data scraping)is the process of collecting content and data from the internet.
This data is saved in a local file so that it can be manipulated and analyzed as needed.
How does a web scraper function ?
Step 1 — Install and Imports
Selenium is a Python library and tool used for automating web browsers to do a number of tasks
Step 2 — Install and Access WebDriver
A webdriver is a vital ingredient to this process. It is what will actually be automatically opening up your browser to access your website of choice. This step is different based on which browser you use to explore the internet.
Step 4 — Wait a second
It is important to put waits into your web-scraper for two reasons:
1- Elements load in sequentially, so the element you are looking for might not load immediately .
Step 5— Locate Specifique Information You’re Scraping
In order to extract the information that you’re looking to scrape, you need to locate the element’s XPath.
An XPath is a syntax used for finding any element on a webpage.
To locate only one element in the website, there are the corresponding methods:
* find_element_by_name
* find_element_by__xpath
* find_element_by__link_text
* find_element_by__tag_name
* find_element_by__class_name
* find_element_by__css_selector
Commentaires
Enregistrer un commentaire