RosettaCode Data Project
========================

This git repository contains (almost) all of the code samples available on
http://rosettacode.org organized by Language and Task.


## Getting the Data

All of the data is in this repository, so you can just run:

    git clone https://github.com/acmeism/RosettaCodeData

*However...*

It's a lot of data!

If you just want the latest data, the quickest thing to do is:

    git clone https://github.com/acmeism/RosettaCodeData --single-branch --depth=1


## Tools

This repository's data content is created by a Perl program called
`rosettacode`.

You can install it with this command:

    cpanm RosettaCode

You can rebuild the data with:

    make build


This repository has a `bin` directory with various tools for working with the
data.

* `rcd-api-list-all-langs`

    List all the programming language names directly from rosettacode.org

* `rcd-api-list-all-tasks`

    List all the programming task names directly from rosettacode.org

* `rcd-new-langs`

    List the RosettaCode languages not yet add to Conf

* `rcd-new-tasks`

    List the RosettaCode tasks not yet add to Conf

* `rcd-samples-per-lang`

    Show the number of code samples per language

* `rcd-samples-per-task`

    Show the number of code samples per task

* `rcd-tasks-per-lang`

    Show the number of tasks with code samples per language

* `rcd-langs-per-task`

    Show the number of languages with code samples per task


## To Do

Pull requests welcome!

This project is not a perfect representation of RosettaCode yet.
It has a few uncicode issues.
It also has to deal with various formatting mistakes in the mediawiki source
pages.

* Fix bugs

* Correct the 100s of guessed file extensions in `Conf/lang.yaml`

* Ability to only fetch cache pages since last pushed data update

* Support names with non-ascii characters

* Add more bin tools

* Address errors reported in rosettacode.log after running `make build`