crawley-project/crawley

.. crawley documentation master file, created by
   sphinx-quickstart on Wed Sep 14 10:05:07 2011.
   You can adapt this file completely to your liking, but it should at least
   contain the root `toctree` directive.

Crawley's Documentation
===================================

Crawley is a pythonic Scraping / Crawling Framework intended to make easy the way you extract data from web pages into structured storages such as databases.


Features
=================

- High Speed WebCrawler built on Eventlet.
- Supports databases engines like Postgre, Mysql, Oracle, Sqlite.
- Command line tools.
- Extract data using your favourite tool. XPath or Pyquery (A Jquery-like library for python).
- Cookie Handlers.
- Very easy to use (see the ``example``).


Table of Contents
=================

.. toctree::

    example
    settings
    reference
    more_examples