Rahisa

Markets are open

RahisaBot

Our web crawler that collects financial data and market information to power comprehensive financial insights for Tanzania

Webmasters can use the following robots.txt tags to manage how their sites and content interact with RahisaBot. Each setting works independently, and it may take up to 24 hours for our systems to reflect changes.

User AgentDescription
RahisaBot

RahisaBot is designed to collect financial data, market information, and company reports to provide comprehensive financial insights for Tanzania. It is used to crawl publicly available financial information and is not used for personal data collection.

Full user-agent string:
Mozilla/5.0 (compatible; RahisaBot/1.0; +https://rahisa.co.tz/bots)

Purpose: Financial data aggregation, market analysis, company report collection

robots.txt Configuration

To control how RahisaBot interacts with your website, add the following to your robots.txt file:

Allow RahisaBot (Recommended)
User-agent: RahisaBot
Allow: /

# Or allow specific directories
User-agent: RahisaBot
Allow: /financial-reports/
Allow: /investor-relations/
Allow: /annual-reports/
Disallow RahisaBot
User-agent: RahisaBot
Disallow: /

# Or disallow specific directories
User-agent: RahisaBot
Disallow: /private/
Disallow: /internal/

Crawler Features

Market Data Collection

Crawls DSE, global markets, and financial news sources for real-time data

Company Reports

Automatically downloads annual reports, quarterly statements, and financial documents

Financial Analysis

Processes and indexes financial data for comprehensive market insights

Respectful Crawling

Follows robots.txt rules and implements rate limiting to respect server resources

Data Sources

RahisaBot responsibly crawls the following types of financial data sources:

  • Dar es Salaam Stock Exchange (DSE) - Company listings and market data
  • Bank of Tanzania - Interest rates and monetary policy updates
  • Tanzania Revenue Authority - Tax regulations and updates
  • Financial news websites - Market analysis and economic reports
  • Company websites - Annual reports and financial statements
  • Global financial APIs - International market data and currency rates

Technical Specifications

SpecificationDetails
User-AgentMozilla/5.0 (compatible; RahisaBot/1.0; +https://rahisa.co.tz/bots)
Crawl RateRespectful delays (3-5 seconds between requests)
robots.txt ComplianceYes - Fully respects robots.txt directives
Content TypesHTML pages, PDF documents, CSV files, JSON APIs
Operating Hours24/7 with reduced activity during peak hours (9 AM - 5 PM EAT)
Data RetentionFinancial data cached for up to 30 days for analysis

Best Practices for Webmasters

  • Use robots.txt

    Clearly specify which parts of your site RahisaBot can access using robots.txt directives

  • Monitor server logs

    Check your server logs to ensure RahisaBot is respecting your crawling preferences

  • Rate limiting

    RahisaBot implements respectful rate limiting, but you can also implement server-side limits if needed

  • Contact us

    If you have concerns about RahisaBot's crawling behavior, please contact our support team

Questions About RahisaBot?

If you have questions about RahisaBot's crawling behavior or need technical assistance, our team is here to help.

support@rahisa.co.tzTechnical DocumentationRahisa Platform