CG数据库 >> Scrape Websites using PhantomJS and CasperJS

$195 | Created by Patrick Schroeder | Last updated 9/2017Duration: 2 hours | Video: h264, 1280x720 | Audio: AAC, 44 KHz, 2 Ch | 710 MBGenre: eLearning | Language: English + Sub | 32 LecturesBecome a better JavaScript Developer and Learn Front-End Testing.

We'll use javascript, lodash and jquery for scraping.

What you'll learnKnow how to use JavaScript for Data MiningUnderstand how to use CasperJS and PhantomJSApply What You've Learned to Front-end TestingCreate Your Own Scripts for Scraping DataHave a Better Understanding of Functional ProgrammingFully Understand JavaScript and jQuery SelectorsRequirementsYou should already be familiar with JavaScript basicsHelpful to know beginner jQuery syntaxDescriptionIn this course you will learn how to scrape data from web pages using CasperJS.

This course consists of 5 example projects to help you fully understand the powers of the headless browser using the CasperJS API.

What You Will LearnYou will gain a thorough understanding of advanced web scraping concepts and also gain an insight into how to use the CasperJS for Testing DOM manipulation and UI interaction.

What to ExpectWe'll begin with an overview of how both PhantomJS and CasperJS works along with how to install these frameworks.

Next, we'll discuss what our workflow will look like and the options we can pass into a Casper object.

Then we'll dive into the meat of this course by working through 5 projects.

The Projects Will CoverHow to scrape websites that are rendered with JavaScript instead of standard HTMLHow to wait for AJAX loaded data to appear before scraping elementsHow to submit forms both for Authorization and when making searchesHow to define navigation Steps - like logging into a site, clicking a button and following linksAnd how to take screenshots both of full web pages and specific containersWhat is PhantomJS?PhantomJS is a Full Web Stack that employs a headless browser.

Phantom gives us the power to perform many interesting actions on a web page, such as: performing page manipulation, simulating user interaction and the ability to dynamically capture and save website data.

What is CasperJS?CasperJS is a stand-alone framework built on top Phantom and is compatible with most operating systems.

The focus of this course will be on the Casper API and we'll be using this API to write all our web scraping scripts.

What You Should KnowYou should already know JavaScript basics.

Including what a callback function is.

It will help if you know some jQuery.

We use lodash in of our examples but only as a replacement for the built-in Map method that's part of the native Javascript API.

Who is the target audience?You should take this course if your interested in becoming a better JavaScript developer.

This course is meant for those who are already familiar with the basics of JavaScript.

No prior knowledge of PhantomJS or CasperJS is required.


Scrape Websites using PhantomJS and CasperJS的图片1
Scrape Websites using PhantomJS and CasperJS的图片2
Scrape Websites using PhantomJS and CasperJS的图片3
Scrape Websites using PhantomJS and CasperJS的图片4

发布日期: 2018-11-26