About Me
- With 18+ years of IT experience, specializing in Data Engineering, Software Engineering, and Database Administration.
- 15+ years of experiences with writing SQL, stored functions, procedures, packages and SQL optimization.
- Possessing 5+ years of hands-on experience with Big Data technologies, including the Hadoop ecosystem (HDFS, Hive, Spark, Sqoop), AWS EMR, Google Cloud Dataproc, etc.
- Bringing 12+ years of expertise in ETL, Database Administration, and Software Development.
- Having 5+ years of working experiences with major public cloud like AWS, Google cloud and Azure.
- Having 4+ years of practical experience with DevOps tools like Jenkins, Git, GitLab, Docker, Kubernetes, CI/CD, Ansible, Terraform.
- Having 2+ years of working experiences with data science and machine learning.
- Having working experience with RDBMS (MySQL, PostgreSQL, MSSQL, Oracle) and NoSQL (MongoDB, Elasticsearch, Redis) databases.
- Designed and Developed data warehouse solution in Google Big Query, AWS Redshift and Snowflake.
- Worked on AWS Components like RDS, S3, EMR, Athena, Glue, EC2 and Google Cloud components Cloud SQL, Cloud Storage, Dataproc, Composer, Cloud function, Cloud Run and Compute Instance.
- Real time experience in Hadoop/Big Data related technology experience in Storage, Querying, Processing, and analysis of data.
- Knowledge in installing, configuring, and using Hadoop ecosystem components like HDFS, Hive, Sqoop, and Spark.
- Experienced in ETL (Extract, Transform, Load) and ELT design, development, and testing.
- Having experience with data migration, database migration and conversion, and database administration.
- Implemented database security, backup, capacity, and recovery plan
- Developed web and desktop applications using Microsoft .Net (C#, ASP.net, VB.net).
- Develop data scraping application.
- Worked with machine learning with LangChain and streamlit.