Skip to content

Freelance · Data & AI

Data Engineering & Pipelines

Operational data is only useful once it's flowing reliably and modelled well. I build pipelines that move data from source systems — factories, sensors, applications — through transformations into analytics and dashboards.

Discuss your projectAll services
  • Kafka
  • Confluent Kafka
  • DBT
  • Python
  • SQL
  • Power BI
  • PostgreSQL

What I can help with

Data pipelines — what's included

  • 01

    Streaming pipelines

    Moving data in real time with Kafka and Confluent.

  • 02

    Transformations with DBT

    Modelling raw data into clean, analysis-ready tables.

  • 03

    Data processing

    Python processing for structured and unstructured data.

  • 04

    Reporting

    Power BI reports and dashboards on top of the pipeline.

  • 05

    Sensor & time-series data

    Processing high-frequency readings from devices.

Relevant experience

Built on real work

  • Factory data pipelines

    Actalyst

    Kafka, Confluent Kafka and DBT pipelines for manufacturing data, plus data visualization.

  • Manufacturing Data Pipeline

    Project

    Streaming factory data through Kafka / Confluent with transformations in DBT.

  • Time-series data processing

    IST Technologies

    Processing environmental sensor data at scale.

See projects & experience

A good fit if…

  • Your data lives in several systems and needs to come together
  • You need near real-time data, not nightly exports
  • You're setting up analytics for operations or manufacturing

Remote · based in Hyderabad, India

How we'll work

A clear process, even when the problem isn't

I don't need to know everything before I start — I need to know how to figure it out.

  1. 01

    Understand

    Break down the problem and understand the system.

  2. 02

    Explore

    Research technologies and possible approaches.

  3. 03

    Build

    Create a practical working implementation.

  4. 04

    Debug

    Find bottlenecks, failures, and edge cases.

  5. 05

    Improve

    Optimize performance, reliability, scalability, and usability.

  6. 06

    Ship

    Deploy, monitor, support, and iterate.

Contact

Have a problem worth solving?

Whether you're building a product, solving a technical challenge, or exploring an interesting idea, I'd be happy to connect.

manjithreddy096@gmail.com
GitHub(opens in a new tab)LinkedIn(opens in a new tab)

Remote · based in Hyderabad, India

Send a message