BitQuery

BitQuery is a GitHub API driven and D3 based search engine for open source repositories (OSR).

BitQuery pursues two main objectives:

(I) Provide an automatic OSR categorization system for data science teams and software developers promoting discoverability, technology transfer and coexistence

(II) Establish visual data exploration and topic driven navigation of GitHub organizations for collaborative reproducible research (CRR) and web deployment

A node filter component for BitQuery VA-App: zoom and filter. Filters data according to legend filter settings

The BitQuery architecture consists of three abstraction layers, following the visual analytics approach (D. Keim, 2008):

GitHub API based parser layer (Data Management)

Smart Data layer (Data Analysis)

Visual Analytics application or VA-App (Data Visualization)

Visual Analytics layouts of BitQuery include: CRAN edition, Special edition and GitHub edition.

BitQuery was presented at Data Science, Statistics & Visualization Conference 2017, Lisbon, Portugal:

Abstract: BitQuery - GitHub API driven and D3 based search engine for open source repositories

Talk: BitQuery - GitHub API driven and D3 based search engine for open source repositories

The CRAN Edition aims at providing visual exploration of the R universe, a massive collection of all R packages on GitHub including CRAN (the Comprehensive R Archive Network) and Bioconductor (the collection of R packages for the analysis of genomic data). Find out more on CRAN Edition website.

BitQuery CRAN Edition

The Special Edition illustrates a great potential of BitQuery for visual data mining of open source libraries, package networks and other well-documented data collections. The following metadata types are considered: YAML, DCF, JSON and Markdown.

DSSV 2017 members

Data Science, Statistics & Visualisation is a Satellite Conference of the 61st World Statistics Congress, promoted by IASC. 12-14 July 2017, Instituto Superior Técnico, Lisbon, Portugal. For more information, see DSSV official website.

Ebooks from GITenberg

The collection of electronic books (or ebooks) from GITenberg, a free and open, collaborative, trackable and scriptable digital library. Currently, the library has over 49,000 books available in different formats.

R packages hosted on GitHub

A collection of R packages on GitHub including CRAN and Bioconductor.

npm packages hosted on GitHub

npm is the package manager for JavaScript and the world’s largest software registry.

PHP packages hosted on GitHub

Composer is the package manager for the PHP programming language.

GitHub READMEs

Markdown is a lightweight and easy-to-use syntax for styling all forms of writing on the GitHub platform.

Find out more on the Special Edition website.

BitQuery Special Edition

The GitHub Edition is a Visual Analytics layout of BitQuery intended for an interactive visual knowledge discovery of GitHub organizations.

With the growing popularity of GitHub, the largest host of source code and collaboration platform in the world, it has evolved to a Big Data resource offering a variety of open source repositories. Since 2010 GitHub offers organizations, simplifying management of group-owned repositories, and thus facilitating the GitHub workflow for business and large open source projects. At present, there are more than one million organizations on GitHub, among them Google, Facebook, Twitter, Yahoo, CRAN, RStudio, D3, Plotly and many more.

Find out more on the GitHub Edition website.

BitQuery GitHub Edition