Design, develop, and maintain high-performance, highly available backend services and APIs for Big Data products using Java/Python. Manage full service lifecycle, capacity planning, profiling/benchmarking, troubleshooting, security, and system architecture. Contribute to open-source big data projects and build scalable tools for global operations.
Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by 300+ million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance offerings range from trading and finance to education, research, payments, institutional services, Web3 features, and more. We leverage the power of digital assets and blockchain to build an inclusive financial ecosystem to advance the freedom of money and improve financial access for people around the world.
About the Team
We are building an enterprise-grade big data infrastructure platform, similar to AWS EMR, Databricks Runtime, and Google Dataproc. Our mission is to provide a highly scalable, cloud-native, and reliable computing platform for large-scale data processing and AI workloads.
This role focuses on the framework development, performance optimization, stability engineering, and cloud-native transformation of open-source distributed computing engines such as Hadoop, YARN, HDFS, and Spark. This is NOT a data development, ETL development, or business analytics role.
Responsibilities
- Design, develop, and maintain enterprise-grade big data infrastructure platforms (EMR-like Platform).
- Develop and enhance distributed computing frameworks, including Hadoop, Spark, YARN, and HDFS.
- Build service capabilities for big data engines such as Spark, Hive, Presto, and Flink.
- Drive cloud-native transformation by integrating big data engines with Kubernetes and related ecosystem components.
- Optimize cluster performance, resource utilization, scheduling efficiency, and workload throughput.
- Improve platform stability, reliability, and observability for large-scale production environments.
- Troubleshoot and resolve complex performance bottlenecks and distributed system issues across large-scale clusters.
- Contribute to the evolution of big data platform architecture and infrastructure best practices.
Requirements
- Bachelor's degree or above in Computer Science, Software Engineering, or a related field.
- Strong experience in distributed systems and big data infrastructure development.
- Hands-on experience with Hadoop, Spark, HDFS, YARN, Hive, Flink, Presto, or related open-source computing frameworks.
- Experience building or operating enterprise-grade big data platforms such as AWS EMR, Databricks Runtime, Google Dataproc, Huawei MRS, Alibaba Cloud E-MapReduce, Tencent Cloud EMR, or similar platforms.
- Experience with Kubernetes and cloud-native deployment of distributed computing engines (e.g., Spark Operator).
- Experience operating or developing large-scale clusters (1,000+ nodes) is highly preferred.
- Strong understanding of distributed system architecture, performance tuning, resource scheduling, and stability engineering.
- Proficiency in Java, Scala, Go, or C++, with solid software engineering fundamentals.
Preferred Qualifications
- Contributor or Committer experience in Apache Hadoop, Spark, Flink, or related open-source communities.
- Experience designing cloud-native big data infrastructure or containerized compute platforms.
- Experience optimizing large-scale production clusters for performance, stability, and cost efficiency.
- Familiarity with modern observability, monitoring, and distributed system troubleshooting.
Ideal Background
- AWS EMR
- Databricks Runtime
- Google Dataproc
- Alibaba Cloud E-MapReduce
- Tencent Cloud EMR
- Huawei MRS
- Apache Hadoop / Spark Committer
- Spark Core Development
- Large-scale Distributed Systems or Cloud Infrastructure Teams
Candidates may come from teams such as:
Why Binance
• Shape the future with the world’s leading blockchain ecosystem
• Collaborate with world-class talent in a user-centric global organization with a flat structure
• Tackle unique, fast-paced projects with autonomy in an innovative environment
• Thrive in a results-driven workplace with opportunities for career growth and continuous learning
• Competitive salary and company benefits
• Work-from-home arrangement (the arrangement may vary depending on the work nature of the business team)
Binance is committed to being an equal opportunity employer. We believe that having a diverse workforce is fundamental to our success.
By submitting a job application, you confirm that you have read and agree to our Candidate Privacy Notice.
Similar Jobs
Blockchain • Fintech • Software • Cryptocurrency • Metaverse
Early-career Product Manager in analytics/strategy focusing on behavioral data analysis, A/B testing, funnel diagnostics, and recommendation ranking optimization. Produce strategy docs and PRDs, collaborate with algorithm teams, develop labels/taxonomies, and deliver actionable insights from experiments and data extraction.
Top Skills:
A/B TestingData WarehousesExplore-Exploit)PandasPythonRecommender Systems (Ctr/CvrSQL
Professional Services • Real Estate • Consulting
Join a 24-month structured graduate programme to develop project management skills on property, infrastructure and construction projects. Support project delivery by producing plans, monitoring progress, managing time/cost/quality processes, tracking changes, liaising with stakeholders, coordinating meetings and producing reports, while receiving accredited training, mentorship and practical on-the-job experience.
Fintech • Financial Services • Cryptocurrency
Manage and grow a portfolio of VIP clients in Northeast Asia, provide white-glove support, monitor trading behavior, coordinate with product/ops/compliance to resolve issues, support client acquisition via events and campaigns, and maintain accurate client records and reporting.
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
