Transforming data into business value through scalable cloud solutions

Data Engineer with 5+ years of professional experience and 10+ years in technology, specializing in Python, Apache Airflow & FinOps. Proven track record in building scalable ETL/ELT pipelines and implementing cloud cost optimization strategies for financial services and e-commerce companies.

• Data Engineering: Apache Airflow, Apache Spark (PySpark), Databricks, Kafka
• Cloud Optimization: AWS to OCI migration, FinOps practices, Infrastructure cost reduction
• Programming: Python (Pandas, NumPy, Boto3), SQL, Go
• Database Management: PostgreSQL, MySQL, MongoDB, Oracle, SQL Server
• DevOps: Docker, Terraform, GitHub Actions, CI/CD pipelines

• 🌩️ Cloud Migration: Led zero-downtime migration of legacy financial systems to Oracle Cloud Infrastructure
• 💰 Cost Optimization: Achieved significant infrastructure cost reduction through strategic cloud migration
• 📊 Scale Processing: Managed hundreds of Airflow DAGs processing millions of daily financial transactions
• 🔧 Performance Improvement: Optimized Databricks/Spark clusters and SQL queries for better performance
• 📈 Uptime Excellence: Maintained high reliability for financial data processing systems
• 🤖 Automation Impact: Substantially reduced manual errors through Python automation scripts
• ⚡ Incident Response: Significantly improved incident response time through proactive monitoring

• Companies: PicPay (Fintech)
• Tech Stack: Apache Airflow, Apache Spark, Oracle Cloud Infrastructure
• Scope: Hundreds of DAGs processing millions of daily transactions

• Achievement: Strategic AWS to OCI migration with cost reduction
• Tools: Oracle Data Pump, Terraform, Cloud monitoring tools
• Impact: Ensured business continuity during financial system migrations by minimizing downtime and overall impact

• Company: INPE (Space Research Institute)
• Project: Atmospheric research data processing and astronomical observation
• Tech Stack: Python (PyQt, NumPy), Shell scripting, GitHub

I'm always interested in discussing:

• 🔧 Data Engineering best practices & Apache Airflow
• ☁️ Cloud cost optimization strategies (FinOps)
• 🏗️ Large-scale data processing architectures
• 💳 Financial services data challenges

Platform	Link	Direct Access
	Professional Profile	linkedin.com/in/pliniopereira
	Code Repository	github.com/pliniopereira
	Send Message	[email protected]

💬 Let's connect! Feel free to reach out for collaborations, opportunities, or just to say hello!