ETL Code

ETL Code is a Visual Studio Code extension that provides an intuitive, node-based interface for building Extract, Transform, Load (ETL) pipelines. Built with React Flow and TypeScript, it enables developers and data engineers to design complex data transformation workflows through drag-and-drop interactions while maintaining code-level flexibility. Key Features Visual Pipeline Designer: Create ETL workflows by connecting source nodes (CSV, databases), transformation nodes (filters, maps, aggregations), and target nodes (SQLite, PostgreSQL/Supabase) in an interactive canvas. Each node is fully configurable with real-time validation and field mapping support. AI-Powered Mapping: Integrated AI service intelligently suggests field mappings between source and target schemas, reducing manual configuration time. The system analyzes data types, naming patterns, and semantic relationships to provide high-confidence mapping recommendations. Robust Execution Engine: Complete backend infrastructure with comprehensive logging, error handling, and automatic database fallback mechanisms. Supports multiple database connectors with connection pooling and transaction management. MCP Integration: Implements Model Context Protocol (MCP), exposing ETL capabilities as tools for AI assistants like IBM Bob and Cline. Users can describe data transformation needs in natural language and receive fully-configured, executable pipelines. The MCP server runs on HTTP/SSE transport (port 3001) for universal accessibility. Advanced Compiler: Semantic compiler pipeline with field propagation rules, type system validation, expression parsing, and workflow serialization. Ensures data integrity and type safety throughout the transformation process. Developer Experience: Clean architecture with React-based webviews, Node.js execution engine, event-driven communication, hot-reload support, comprehensive test suites, and detailed documentation for users and contributors.