Skip to content

Latest commit

ย 

History

16 Commits

Folders and files

NameName
Last commit message
Last commit date
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

DataForge CLI Banner



DataForge CLI

Your AI consultant, inside the terminal.

Scan. Explain. Document. Ship.

DataForge turns any codebase into structured knowledge โ€” architecture reports, dependency maps, onboarding guides, and production-grade documentation โ€” generated by AI, without ever leaving your shell.


Python Multi--AI Platform License Version


[Website] [The website is under development.] ยท [Docs] [The website is under development.] ยท [Pricing] [The website is under development.] ยท GitHub


Tip

New to the command line? You don't need Git. Download the repo as a ZIP, extract it, and run one command โ€” see Installation below.


Table of Contents


๐Ÿ“– Why DataForge?

Reading someone else's codebase โ€” or your own from six months ago โ€” takes time you don't have.

DataForge CLI automates that first pass.

Point it at a project. DataForge scans the codebase, builds structured context, and sends that context to your selected AI provider to generate useful developer intelligence.

No copy-pasting files into a chat window. No manually building architecture documentation. No leaving your terminal.

Local-first. Multi-provider. Developer-first.

Your code never touches a DataForge server.

Reports are generated locally and saved locally. The only network requests DataForge makes are to your selected AI provider, using your own API key โ€” or to no network at all when using Ollama locally.


โšก Quick Start

Clone the repository:

git clone https://github.com/RabbitGamesDev/DataForge-CLI.git
cd DataForge-CLI/dataforge-cli

Install dependencies:

pip install -r requirements.txt

Launch DataForge:

python main.py

The first launch opens an interactive setup wizard where you can configure your AI engine, language, and terminal theme.

Then scan your first project:

python main.py scan .

Your generated reports will appear in:

dataforge-reports/

That's it. Your codebase just became AI-readable knowledge.


๐Ÿง  How DataForge Works

                         YOUR CODEBASE
                              โ”‚
                              โ–ผ
                   โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                   โ”‚   DATAFORGE SCANNER โ”‚
                   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                              โ”‚
             โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
             โ–ผ                โ–ผ                โ–ผ
        Architecture     Dependencies        Context
             โ”‚                โ”‚                โ”‚
             โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                              โ”‚
                              โ–ผ
                   โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                   โ”‚      AI ENGINE      โ”‚
                   โ”‚                     โ”‚
                   โ”‚ Groq / OpenAI       โ”‚
                   โ”‚ Gemini / Claude     โ”‚
                   โ”‚ Ollama              โ”‚
                   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                              โ”‚
                              โ–ผ
                   โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                   โ”‚  STRUCTURED OUTPUT  โ”‚
                   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                              โ”‚
             โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
             โ–ผ                โ–ผ                โ–ผ
        AI Reports       Documentation    Architecture
        Risk Analysis    Onboarding       Maps

DataForge is designed to turn a codebase from something you have to understand into something you can immediately work with.


๐Ÿ“ฆ Installation

Option 1 โ€” Git Clone (recommended for developers)
git clone https://github.com/RabbitGamesDev/DataForge-CLI.git
cd DataForge-CLI/dataforge-cli
pip install -r requirements.txt
python main.py
Option 2 โ€” Download as ZIP (no Git required)
  1. Open the [DataForge CLI Website Installation] [The website is under development.].
  2. Click ZIP โ†’ Download DataForge-CLI-main.zip.
  3. Extract the archive anywhere on your computer.
  4. Open a terminal inside the extracted dataforge-cli folder.
  5. Install the dependencies:
    pip install -r requirements.txt
  6. Start DataForge:
    python main.py
Option 3 โ€” One-Click Installation

A one-line installer is also available through the [official DataForge CLI website] [The website is under development.] for Windows, macOS, and Linux.


๐Ÿš€ Run DataForge From Anywhere

On Windows, you can create a launcher so you don't need to navigate into the project directory every time.

Create a file named:

dataforge.bat

Add:

@echo off
python "C:\PATH\TO\DataForge-CLI\dataforge-cli\main.py" %*

Add the folder containing the launcher to your system PATH.

You can then run:

dataforge scan .

from anywhere.


๐Ÿ’ป Command Reference

Core Commands
Command Description Tier
python main.py scan . Full project scan โ†’ architecture, risks, and suggestions Free
python main.py explain main.py Explain a specific file Free
python main.py map . Generate an ASCII architecture / dependency map Free
python main.py ask . Interactive AI chat with project context Free
python main.py onboard . Generate a developer onboarding guide Free
python main.py welcome Open the DataForge welcome letter Free
Advanced Commands
Command Description Tier
python main.py doc++ . Production-ready documentation โญ Pro / ๐Ÿ’œ Teams
python main.py architecture++ . Mermaid architecture diagrams + deep analysis โญ Pro / ๐Ÿ’œ Teams
python main.py export . --html Export reports to Markdown, JSON, or HTML โญ Pro / ๐Ÿ’œ Teams
python main.py preset onboarding . Run automated multi-step pipelines โญ Pro / ๐Ÿ’œ Teams
Configuration & Licensing
Command Description Tier
python main.py setup Configure AI engine, language, and terminal theme All
python main.py license YOUR_KEY Activate or check a license All
python main.py license status Check current license status All
python main.py help Display available commands All

Free tier note: setup uses Groq as the default AI engine and provides the default terminal theme. Pro unlocks additional terminal themes. Teams unlocks full multi-provider selection.


๐Ÿท๏ธ Plans & Licensing

DataForge follows an Open-Core model.

The core CLI remains available under the Apache License 2.0, while Pro and Teams unlock advanced functionality and commercial workflows.

Feature ๐ŸŸข Free โญ Pro ๐Ÿ’œ Teams
scan, explain, map, ask, onboard โœ… โœ… โœ…
Default terminal theme โœ… โœ… โœ…
Additional terminal themes โ€” โœ… โœ…
doc++ โ€” โœ… โœ…
architecture++ โ€” โœ… โœ…
export โ€” โœ… โœ…
Automated presets โ€” โœ… โœ…
Multi-provider AI โ€” โ€” โœ…
Enterprise report branding โ€” โ€” โœ…
Custom report signature โ€” โ€” โœ…

โ†’ [See full pricing on the DataForge website] [The website is under development.]


๐Ÿ” How Hybrid Licensing Works

DataForge uses a hybrid licensing model designed to protect commercial licenses without making the CLI dependent on a permanent internet connection.

                    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                    โ”‚   dataforge license    โ”‚
                    โ”‚       YOUR-KEY         โ”‚
                    โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                                 โ”‚
                                 โ–ผ
                     Lemon Squeezy validation
                                 โ”‚
                                 โ–ผ
                    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                    โ”‚ ~/.dataforge/          โ”‚
                    โ”‚ license.json           โ”‚
                    โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                                 โ”‚
                          Local validation
                                 โ”‚
                    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
                    โ”‚                         โ”‚
               Every 7 days              No internet
                    โ”‚                         โ”‚
                    โ–ผ                         โ–ผ
             Heartbeat check          Offline grace period
                    โ”‚                         โ”‚
                    โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                                 โ–ผ
                        DataForge continues
                        working locally

Licensing principles

  • Local-first validation โ€” license information is cached locally for fast routine checks.
  • Periodic verification โ€” DataForge periodically verifies the commercial license status.
  • Offline grace period โ€” temporary loss of internet connectivity does not immediately interrupt local development.
  • No DataForge cloud dependency โ€” DataForge does not require a permanent connection to a DataForge server.

Current status: Lemon Squeezy integration is being finalized for automated checkout, license delivery, and full customer synchronization.


๐Ÿค– AI Providers

DataForge is built around a multi-provider architecture.

Provider Strength Requires
Groq Ultra-fast responses API key
OpenAI Strong logical reasoning API key
Gemini Large-context, multi-step analysis API key
Claude Production-quality technical writing API key
Ollama Fully local and offline AI Local Ollama installation

Configure your provider with:

python main.py setup

Provider availability depends on your current DataForge plan.

๐Ÿง  Fully Offline with Ollama

When using Ollama with a locally installed model, DataForge can operate without sending project data to an external AI provider.

Your Code
   โ”‚
   โ–ผ
DataForge CLI
   โ”‚
   โ–ผ
Local Ollama Model
   โ”‚
   โ–ผ
Generated Report

๐Ÿ“ Project Structure

DataForge-CLI/
โ”œโ”€โ”€ README.md
โ”œโ”€โ”€ LICENSE
โ”œโ”€โ”€ CHANGELOG.md
โ”œโ”€โ”€ CONTRIBUTING.md
โ”œโ”€โ”€ SECURITY.md
โ”‚
โ””โ”€โ”€ dataforge-cli/
    โ”œโ”€โ”€ dataforge/
    โ”‚   โ”œโ”€โ”€ __init__.py
    โ”‚   โ”œโ”€โ”€ api_handler.py      # Multi-provider AI routing
    โ”‚   โ”œโ”€โ”€ config_manager.py   # config.json + license.json    management
    โ”‚   โ””โ”€โ”€ core.py             # File scanning, reading, report saving
    โ”œโ”€โ”€ dataforge-reports/      # Generated reports land here
    โ”œโ”€โ”€ .gitignore
    โ”œโ”€โ”€ main.py                 # CLI entry point + command router
    โ””โ”€โ”€ requirements.txt

๐Ÿ”’ Security & Local-First Architecture

DataForge is designed with a local-first philosophy.

  • API keys are stored locally under ~/.dataforge/.
  • On Windows, the configuration directory is located under %USERPROFILE%\.dataforge.
  • License information is stored locally for validation and offline operation.
  • Generated reports remain on your machine.
  • DataForge itself does not upload your codebase to a DataForge server.
  • External AI requests are made to the provider you configure.
  • Ollama can be used for fully local AI processing.
  • Sensitive local configuration files are excluded through .gitignore.

What leaves your machine?

Under normal operation, DataForge does not send your project to a DataForge-controlled cloud service.

  • When using a cloud AI provider such as Groq, OpenAI, Gemini, or Claude, the relevant project context is sent directly to that provider's API according to your configuration and their applicable policies.
  • When using Ollama locally, processing can remain entirely on your machine.

๐Ÿ—บ๏ธ Roadmap

โœ… Completed

  • v1.0 โ€” Interactive setup, Groq integration, and modular report generation
  • v1.5 โ€” Multi-provider support, offline Ollama integration, and expanded commands
  • v2.0 โ€” Hybrid licensing architecture
  • v2.0 โ€” Pro & Teams tiers
  • v2.0 โ€” Multi-format export
  • v2.0 โ€” Official website
  • v2.0 โ€” Customer portal foundation
  • v2.0 โ€” Live web dashboard
  • v2.0 โ€” Google Analytics integration
  • v2.0 โ€” Automatic browser-language translation

๐Ÿšง In Progress

  • v2.1โ€“v2.3 โ€” Fully automated Lemon Squeezy checkout
  • v2.1โ€“v2.3 โ€” Instant license delivery
  • v2.1โ€“v2.3 โ€” Real-time customer dashboard synchronization

๐Ÿ”ฎ Planned

  • v2.5 โ€” Community plugin system
  • v2.5 โ€” Integrated static security analysis (SAST)
  • v2.5+ โ€” Secure cloud synchronization for distributed teams

โ†’ [View the full roadmap] [The website is under development.]


๐Ÿค Contributing

DataForge is being built in the open.

Issues, pull requests, suggestions, and feature requests are welcome.

If you discover something broken or have an idea that could improve DataForge, please open an Issue.

Early feedback directly helps shape what gets built next.


๐Ÿ“„ License

DataForge CLI is licensed under the Apache License 2.0.

See the complete license text in LICENSE.

The open-source core remains available under Apache 2.0. Commercial features are provided through the DataForge Open-Core model.


Developed by [RGS Labsโ„ข] [The website is under development.]

๐ŸŒ [Official Website] [The website is under development.] ยท ๐Ÿ’ป GitHub ยท ๐Ÿ› Issues


โญ If DataForge saves you time, consider starring the repository. It genuinely helps.


Made with โค๏ธ by RGS Labsโ„ข

About

AI-powered CLI toolkit for analyzing, documenting and understanding codebases directly from your terminal. Built with a Local-first, Fast and Professional philosophy.

Topics

Resources

Contributing

Security policy

Stars

1 star

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages