Mujahid Niaz

I'm a Big Data Engineer working in Berlin, Germany

About Me

About Me

Mujahid is a results-driven, customer-focused, articulate and analytical Big Data Engineer & Professional Services Consultant who can think “out of the box”. Strong in design and integration problem solving skills. Working in Big Data Hadoop, Spark, Hive,Teradata, Redshift, Kinesis, EMR, S3,EC2, RDS. Strong experience in open soruce technologies Apache Flink, Apache Airflow, Apache Kafka, Redis, Elasticsearch, Mysql, MongoDB, Docker. Development experience in Java, Python, Scala and C# with data processing, analysis and design. Skilled in developing business plans, requirements specifications, user documentation, and architectural systems. Strong written and verbal communications. Interested in Big Data Challenges .

AWS Stack: EC2, S3, Lambda, Kinesis,EMR, Redshift, Glue, Athena, SES, SQS, DynamoDB, AWS RDS 92%
DevOps Stack: Jenkins, Ansible, Docker, Kubernetes, Prometheus, Grafana,AWS CodePipeline, AWS CodeBuild, AWS CloudFormation, AWS Elastic Beanstalk, Azure DevOps, Azure Kubernetes Service (AKS), Azure DevTest Labs 85%
Open Source: Hive, Hadoop, Apache (Flink,Airflow,Kafka), Redis, Elasticsearch, Mysql, MongoDB, Docker 90%
Google Stack: BigQuery, Compute Engine, Cloud Storage, CloudSQL80%
Azure Stack: Databricks, Data Factory, Data Lake, HDInsights, CosmosDB, AzureSQL 75%
My Resume

My Resume

I have 6 years of experience in Software & Big Data Engineering. During this period, I have worked for Fides Technologies, Teradata, Krieger Digital & Sonova Global.

Professional Experience

Big Data Engineer

2023 - Present

Sonova Global, Berlin, Germany

Working as Big Data Engineer and moslty responsible for

  • Design, develop, and maintain data pipelines for efficient data collection, processing, and storage from various sources.
  • Implement data transformation and enrichment processes to ensure high-quality and consistent data for analytics and reporting purposes.
  • Utilize Snowplow Analytics open-source pipeline to capture event-level data and gain insights into customer interactions and experiences.
  • Work with AWS and Azure cloud technologies to build and deploy scalable and cost-effective data solutions.
  • Architect and develop a centralized Data Hub to facilitate global data collection and reporting, providing a comprehensive view of data.
  • Monitor data pipeline performance and optimize workflows for efficiency and cost-effectiveness.
  • Investigate and resolve data-related issues to ensure data accuracy and integrity throughout the pipeline.
  • Implement automation and continuous integration/continuous deployment (CI/CD) processes to streamline data pipeline development and deployment.

Big Data Engineer

2020 - Present

Krieger Digital, Berlin, Germany

Working as Big Data Engineer and moslty responsible for

  • Managing Upgrades and Services on AWS Cloud infrastructure
  • Deploying and Managing Services using Helm Charts on Kubernetes
  • Buidling and Managing ETL Data pipelines for multiple Data Sources to collect Data in Redshift
  • Building and managing Real time data pipelines using open AWS Kinesis and Apache Flink technogies
  • Contributing into development of Internal Data Warehouse
  • Data Processing using Apache Spark (Scala + Python) and Pandas in Python
  • Working on Kubernetese to automate deployments using Gitlab CI/CD
  • Data Visualizations and Dashboards using Apache Superset

Global Delivery Ctr Consultant (Big Data Analytics)

2016 - 2020

Teradata Global Delivery Center, Islamabad, Pakistan

Worked at Teradata GDC Pakistan as Global Delivery Ctr Consultant where i had diverse experince in multiple domains due to working on multiple project in multiple domains Included following Major Projects :

  • Data Migration between Teradata & Hadoop Cluster
  • Building Big Data Pipelines with Kafka->Spark->HBase->Hive
  • Building Real-Time data pipelines with Apache Kafka & Spark
  • Teradata Azure Deployment Accelerator
  • Setting up Teradata DWH (Vantage) on AWS.
  • Application Deployement using Dockers Containers
  • Teradata GDC Status Portal (.Net + SQL Server)
  • Teradata Automations & Performance Enhacments with UDFs (Java)
  • Software Development (Java,Cit, C++, Python,Scala,JavaScript)

Software Engineer (Machine Learning)

2015 - 2016

Fides Technologies, Islambad, Pakistan

I have worked with FIDES Technologies for 6 months worked as Software Engineer (Machine Learning) on project to create Customer Behavior Analysis using Data Mining Techniques. Helping Telecom Industry in one2one customer marketing and analyzing Telecom market trends & visualize in interactive graphical visualizations dashboards (D3.js)

Education

Bachelors in Computer Science

2012 - 2016

National University of Computer and Emerging Sciences, Islamabad, Pakistan

Majors: Data Mining, Information Retrieval, Concurrent & Distributed Computing, Digital Image Processing, Artificial Intelligence, Data Warehousing, Human Computer Interaction, Software Engineering, and Web Programming

Certifications & Trainings

Teradata 14 Certified Professional

Certification for setting up Teradata Data warehouse in a new environment from scratch

Teradata - Intro to Vantage

Trained for Teradata Vantage Analytics solution

DevOps Generalist

DevOps Basics and Essentials

Microsoft Certified: Azure Fundamentals

Intro to Microsoft Azure Services

AWS Business Professional

Accreditation for AWS services for business point of view

AWS Business Professional

Accreditation for AWS services for technical point of view

Awards & Recognitions

3 Years of Service Award (R&D) 2020 by Teradata Coroporations

Received recognition for my work in R&D field

Teradata Innovation Champion 2018

Received recognition for developing out of the box solution for Teradata Interal Tools for Cloud Deployments

2nd Position in App Development SIST 2019

Participated and won 2nd position in App development competition at SIST 2019

Recomendations

Recomendations

Jan Brusch

Senior MLOps & Data Engineer, Freelance

Mujahid and I worked together on the same Data Engineering team for almost two years. Together, we built real-time streaming applications as well as web tracking data pipelines. I have got to know him as an ambituous yet humble person who is a treat to work with and a pleasure to talk with beyond working matters. A consummate professional, who will work on a problem until he has found a solution. Quick to pick up new concepts and eager to improve himself by having an eye on emerging technologies. Mujahid will be a great addition to your engineering team on a professional and a personal level.

Muhammad Haider Sarfraz

Senior Software Engineer at 10Pearls

Mujahid Niaz is an exceptional talent. He is a man of commitment who has a keen eye for detail, a clear vision of the end goal and a quick wit, that guides his journey. His sharp mind, passion for the field and hunger for growth makes him an incredible asset to have. Even after his brilliant achievements so far, I believe that he has the potential to grow further into a force to be reckoned with in the Global IT market

Ali Kahoot

Lead DevOps Engineer & Trainer | Kubernetes | Openshift | Helm | Jenkins | Docker | AWS | Azure

Mujahid is an extremely diligent and technically sound person. I have worked on a lot of course projects with him during our university and after that we have also participated in different hackathons together. I have found him to be very intelligent and committed to his work. He always carried out his tasks on schedule. He would be an asset to any team and I wish him the best for his future endeavors

Afzal Ahmad

Senior Frontend Developer in Engineering at ToolSense

He is not only a creative and energetic professional but also an inspiring person. Highly motivated programmer with a very strong dedication to work. As a programmer, Mujahid Niaz showed his best owned skills.

Hasan Shaukat

Data Scientist, Global Marketing at Sonova Group | Machine Learning

One of the values on our data team was “constant improvement,” and I’ve never seen anyone embrace and embody that philosophy like Mujahid. During the one year we’ve worked together, I’ve watched him constantly look for new challenges to tackle, whether it’s getting to the root of bugs in the Snowplow pipeline, writing automation scripts for the data model, or leading the development of our streaming applications. I've also known him as a friend to date, and we have a great time outdoors. His humor, his symbolic chai and his breathtaking photography lightens up your world. I’ve loved my experience working with Mujahid, and I know that anyone looking to hire or work with him will, too.

Contact Me

Contact Me

Social Profiles