www.ire.org
Search IRE
 Member sign-in
History
How we started, Bylaws, The Arizona Project, Endowment
Membership
Benefits, How to Join, Find an Investigative Journalist, Listservs, Update Your Address
Training
Conferences,
Seminars,
Fellowships,
Training Materials
Resource Center
20,000-plus
investigative stories, 2,000 Tipsheets, Reporting Guides, Beat Sources
Broadcast Center
Videostreamed clips, IRE feeds, IRE videos
Database Library
Government
database collection, Data analysis
Campaign Finance Information Center
Campaign Finance Database, Stories
FOI Center
Columns, Awards, FOIA Database, Tipsheets
The IRE Store
Books, Audio tapes, Databases,
Periodicals, IRE Logo Goods
Job Center
Hot jobs in
journalism, latest fellowships and
grants
IRE Awards
Latest contest, Past winners, How to enter
Educators
IRE Journalism Educators' Center
IRE Board
Elected members, Committees
IRE Staff
Staff members, Contacting us
Privacy Policy
National Institute for Computer-Assisted Reporting
A special Uplink online-only Web scraping primer, created for the May-June 2007 issue.

The basics of

Web Scraping

Audio tips for Web scraping

Linda J. Johnson
CAR Coordinator, Lexington Herald-Leader

John Perry
The Center for Public Integrity

Return to top

Copyright 2007 Investigative Reporters and Editors

Uplink
Audio:
Past tip sheets (.pdf):
Free tools:
Definitions & acronyms:
  • CPAN
    Comprehensive Perl Archive Network is a good place to start to gain a further understanding of Perl
  • Module:
    A module, also known as a Perl Module, ends in the file extension ".pm"and is a self-contained body of code that a Perl program can use.
  • PPM
    Perl Package Manager is used to manage modules on Microsoft Windows.