Responsible for constructing frameworks for data preparation, building data pipelines, and collaborating with teams to optimize data access and analysis.
Token Metrics is seeking a multi-talented Senior Big Data Engineer to facilitate the operations of our Data Scientists and Engineering team. The Senior Big Data Engineer will be responsible to employ various tools and techniques to construct frameworks that prepare information using SQL, Python, R, Java and C++. The Senior Big Data Engineer will be responsible for employing machine learning techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the field. During various aspects of this process, you should collaborate with coworkers to ensure that your approach meets the needs of each project.
Responsibilities
- Liaising with coworkers and clients to elucidate the requirements for each task.
- Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed.
- Reformulating existing frameworks to optimize their functioning.
- Testing such structures to ensure that they are fit for use.
- Building a data pipeline from different data sources using different data types like API, CSV, JSON, etc.
- Preparing raw data for manipulation by Data Scientists.
- Implementing proper data validation and data reconciliation methodologies.
- Ensuring that your work remains backed up and readily accessible to relevant coworkers.
- Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs.
Requirements
- Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or related field.
- A Master's degree in a relevant field is an added advantage.
- 3+ years of Python, Java or any programming language development experience
- 3+ years of SQL & No-SQL experience (Snowflake Cloud DW & MongoDB experience is a plus)
- 3+ years of experience with schema design and dimensional data modeling
- Expert proficiency in SQL, NoSQL, Python, C++, Java, R.
- Expert with building Data Lake, Data Warehouse or suitable equivalent.
- Expert in AWS Cloud.
- Excellent analytical and problem-solving skills.
- A knack for independence and group work.
- Capacity to successfully manage a pipeline of duties with minimal supervision.
About Token Metrics
Token Metrics helps crypto investors build profitable portfolios using artificial intelligence-based crypto indices, rankings, and price predictions.
Token Metrics has a diverse set of customers, from retail investors and traders to crypto fund managers, in more than 50 countries.
Top Skills
AWS
C++
Java
MongoDB
Python
R
Snowflake
SQL
Token Metrics Austin, Texas, USA Office
7600 Chevy Chase Drive, Austin, TX, United States, 78752
Similar Jobs
eCommerce • Mobile • Payments
The Client Partner will drive revenue growth through client engagement, develop customized sales strategies, meet revenue targets, and ensure account retention while collaborating closely with team members.
Top Skills:
Google SuiteLooker
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
The Talent Media Lead manages paid media strategies and vendor relationships, optimizes recruitment campaigns, budgets, and analyzes performance insights to attract external talent for General Motors.
Top Skills:
Google AnalyticsGoogle Performance MaxLinkedin Campaign ManagerMeta Ads Manager
Artificial Intelligence • Fintech • Machine Learning • Social Impact • Software
As a Software Engineer, you will design and implement personalized offer recommendations, working with cross-functional teams to optimize user engagement and conversion through data-driven strategies.
Top Skills:
KotlinReactRuby On Rails
What you need to know about the Austin Tech Scene
Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.
Key Facts About Austin Tech
- Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
- Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
- Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
- Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center
