# ChartsMaze EDL Pipeline

## Docs

- [Advanced Indicators API](https://mintlify.wiki/Anny26022/chartsmaze_clone/api/advanced-indicators.md): Fetch technical indicators including pivot points, EMAs, SMAs, and RSI sentiment analysis
- [Announcements API](https://mintlify.wiki/Anny26022/chartsmaze_clone/api/announcements.md): Fetch live corporate announcements and events for NSE equity stocks
- [Bulk & Block Deals API](https://mintlify.wiki/Anny26022/chartsmaze_clone/api/bulk-block-deals.md): Fetch institutional bulk and block deals with automatic pagination and deduplication
- [Circuit Stocks API](https://mintlify.wiki/Anny26022/chartsmaze_clone/api/circuit-stocks.md): Fetch stocks hitting upper and lower circuit limits with multi-source fallback
- [Company Filings API](https://mintlify.wiki/Anny26022/chartsmaze_clone/api/company-filings.md): Hybrid dual-endpoint system for fetching comprehensive company filings and regulatory disclosures
- [Corporate Actions API](https://mintlify.wiki/Anny26022/chartsmaze_clone/api/corporate-actions.md): Fetch historical and upcoming corporate actions including dividends, bonuses, splits, and buybacks
- [Dhan ScanX API](https://mintlify.wiki/Anny26022/chartsmaze_clone/api/dhan-scanx.md): Full market data endpoint for fetching comprehensive stock metrics and building master ISIN mappings
- [Fundamental Data API](https://mintlify.wiki/Anny26022/chartsmaze_clone/api/fundamental-data.md): Fetch quarterly results and financial ratios for NSE equity stocks
- [Market News API](https://mintlify.wiki/Anny26022/chartsmaze_clone/api/market-news.md): Fetch live market news with sentiment analysis for NSE equity stocks
- [OHLCV Data API](https://mintlify.wiki/Anny26022/chartsmaze_clone/api/ohlcv-data.md): Fetch historical and live daily OHLCV (Open, High, Low, Close, Volume) data with hybrid multi-chunk mode
- [Price Bands API](https://mintlify.wiki/Anny26022/chartsmaze_clone/api/price-bands.md): Fetch incremental price band changes and complete security lists from NSE archives
- [Surveillance Lists API](https://mintlify.wiki/Anny26022/chartsmaze_clone/api/surveillance-lists.md): Fetch NSE ASM and GSM surveillance lists with multi-source fallback strategy
- [Data Sources](https://mintlify.wiki/Anny26022/chartsmaze_clone/concepts/data-sources.md): Complete reference for all 12+ Dhan and NSE endpoints used in the EDL Pipeline
- [Output Schema](https://mintlify.wiki/Anny26022/chartsmaze_clone/concepts/output-schema.md): Complete reference for the 86-field output schema in all_stocks_fundamental_analysis.json
- [Pipeline Architecture](https://mintlify.wiki/Anny26022/chartsmaze_clone/concepts/pipeline-architecture.md): Understanding the 4-phase EDL Pipeline architecture that powers ChartsMaze data integration
- [Cleanup Configuration](https://mintlify.wiki/Anny26022/chartsmaze_clone/configuration/cleanup-options.md): Control intermediate file cleanup with CLEANUP_INTERMEDIATE flag and understand cleanup behavior
- [Pipeline Configuration Flags](https://mintlify.wiki/Anny26022/chartsmaze_clone/configuration/pipeline-flags.md): Control pipeline behavior with FETCH_OHLCV and FETCH_OPTIONAL flags
- [Cleanup intermediate files](https://mintlify.wiki/Anny26022/chartsmaze_clone/guides/cleanup-intermediate.md): Automatically remove intermediate data files after pipeline completion to save disk space
- [Compression](https://mintlify.wiki/Anny26022/chartsmaze_clone/guides/compression.md): Compress pipeline output to .json.gz format for optimal storage efficiency
- [Custom filters](https://mintlify.wiki/Anny26022/chartsmaze_clone/guides/custom-filters.md): Customize data filters and payloads to fetch specific stocks, sectors, or market segments
- [Error handling](https://mintlify.wiki/Anny26022/chartsmaze_clone/guides/error-handling.md): Understand error handling strategies, recovery mechanisms, and troubleshooting common pipeline failures
- [Incremental Updates](https://mintlify.wiki/Anny26022/chartsmaze_clone/guides/incremental-updates.md): Guide to running efficient daily updates of the ChartsMaze EDL Pipeline
- [Performance tuning](https://mintlify.wiki/Anny26022/chartsmaze_clone/guides/performance-tuning.md): Optimize pipeline execution speed through threading, batching, timeout adjustments, and caching strategies
- [Running the Full Pipeline](https://mintlify.wiki/Anny26022/chartsmaze_clone/guides/running-full-pipeline.md): Complete guide to executing the full ChartsMaze EDL Pipeline to refresh all market data
- [Single Stock Analysis](https://mintlify.wiki/Anny26022/chartsmaze_clone/guides/single-stock-analysis.md): Guide to using single_stock_analyzer.py for detailed fundamental analysis of individual stocks
- [Working with output](https://mintlify.wiki/Anny26022/chartsmaze_clone/guides/working-with-output.md): Load, parse, and analyze the pipeline's compressed JSON output in Python, pandas, and command-line tools
- [ChartsMaze EDL Pipeline](https://mintlify.wiki/Anny26022/chartsmaze_clone/index.md): Production-grade data aggregation platform for Indian stock market intelligence
- [Announcements & News Feed](https://mintlify.wiki/Anny26022/chartsmaze_clone/output/announcements-news.md): Recent regulatory announcements and market news with sentiment analysis
- [Event Markers](https://mintlify.wiki/Anny26022/chartsmaze_clone/output/event-markers.md): Real-time event detection system with icons for surveillance, results, insider trading, deals, and corporate actions
- [Fundamentals (Quarterly)](https://mintlify.wiki/Anny26022/chartsmaze_clone/output/fundamentals.md): Quarterly financial performance fields including Net Profit, EPS, Sales, and OPM across multiple periods
- [Identity & Classification](https://mintlify.wiki/Anny26022/chartsmaze_clone/output/identity-classification.md): Core identification and classification fields for each stock in the ChartsMaze EDL Pipeline output
- [Price Performance](https://mintlify.wiki/Anny26022/chartsmaze_clone/output/price-performance.md): Historical returns across multiple timeframes and distance from 52-week high/low benchmarks
- [Technical Indicators](https://mintlify.wiki/Anny26022/chartsmaze_clone/output/technical-indicators.md): Technical analysis fields including RSI, SMA/EMA status, technical sentiment, and pivot points
- [Valuation Ratios](https://mintlify.wiki/Anny26022/chartsmaze_clone/output/valuation-ratios.md): Key valuation metrics including P/E, Forward P/E, PEG, ROE, ROCE, and Debt-to-Equity ratios
- [Volume & Liquidity](https://mintlify.wiki/Anny26022/chartsmaze_clone/output/volume-liquidity.md): Volume metrics including RVOL, EMA Volume, and rupee turnover indicators for liquidity analysis
- [Master Pipeline Runner](https://mintlify.wiki/Anny26022/chartsmaze_clone/pipeline/master-runner.md): Orchestrates the complete EDL pipeline execution from data fetching to final compression
- [Phase 1 - Core Data](https://mintlify.wiki/Anny26022/chartsmaze_clone/pipeline/phase-1-core.md): Foundation data fetching scripts that produce master ISIN mapping and fundamental metrics
- [Phase 2 - Data Enrichment](https://mintlify.wiki/Anny26022/chartsmaze_clone/pipeline/phase-2-enrichment.md): Multi-threaded data fetching scripts that enrich the master dataset with filings, news, technical indicators, and market surveillance data
- [Phase 3 - Base Analysis](https://mintlify.wiki/Anny26022/chartsmaze_clone/pipeline/phase-3-analysis.md): Core analysis engine that merges fundamental, technical, and market data into the master JSON structure
- [Phase 4 - Enrichment Injection](https://mintlify.wiki/Anny26022/chartsmaze_clone/pipeline/phase-4-injection.md): In-place modification scripts that add advanced metrics, earnings performance, F&O data, and event markers to the master JSON
- [Quickstart](https://mintlify.wiki/Anny26022/chartsmaze_clone/quickstart.md): Run your first EDL Pipeline in 5 minutes and get complete market data
- [F&O Data Scripts](https://mintlify.wiki/Anny26022/chartsmaze_clone/standalone/fno-data.md): Standalone scripts for fetching Futures & Options data including stock lists, lot sizes, and expiry calendars
- [Indices & ETF Scripts](https://mintlify.wiki/Anny26022/chartsmaze_clone/standalone/indices-etf.md): Standalone scripts for fetching market indices and Exchange Traded Funds data
- [OHLCV History Scripts](https://mintlify.wiki/Anny26022/chartsmaze_clone/standalone/ohlcv-history.md): Standalone scripts for downloading lifetime historical OHLCV data for stocks and indices