Senior Data Engineer (Python, SQL, Spark)
Company: Capital One
Location: The Colony
Posted on: October 24, 2024
|
|
Job Description:
Plano 6 (31066), United States of America, Plano, TexasSenior
Data Engineer (Python, SQL, Spark)Do you love building and
pioneering in the technology space? Do you enjoy solving complex
business problems in a fast-paced, inclusive, and iterative
delivery environment? At Capital One, you'll be part of a big group
of makers, breakers, doers and disruptors, who solve real problems
and meet real customer needs. We are seeking Data Engineers who are
passionate about marrying data with emerging technologies. As a
Capital One Data Engineer, you'll have the opportunity to be on the
forefront of driving a major transformation within Capital One.
What You'll Do:
Be a part of team designing and building Enterprise Level scalable,
low-latency, fault-tolerant streaming data platform that provides
meaningful and timely insights
Build the next generation Distributed Streaming Data Pipelines and
Analytics Data Stores using streaming frameworks (Flink, Spark
Streaming) using programming languages like Java, Scala, Python
Be part of a group of engineers building data pipelines using big
data technologies (Spark, Flink, Kafka, Snowflake, AWS Big Data
Services, Snowflake, Redshift) on medium to large scale
datasets
Work in a creative & collaborative environment driven by agile
methodologies with focus on CI/CD, Application Resiliency
Standards, and partnership with Cyber & Security teams
Share your passion for staying on top of tech trends, experimenting
with and learning new technologies, participating in internal &
external technology communities, and mentoring other members of the
engineering community
Collaborate with and across Agile teams to design, develop, test,
implement, and support technical solutions in full-stack
development tools and technologies
Work with a team of developers with deep experience in machine
learning, distributed microservices, and full stack systems
Collaborate with digital product managers, and deliver robust
cloud-based solutions that drive powerful experiences to help
millions of Americans achieve financial empowerment
Perform unit tests and conduct reviews with other team members to
make sure your code is rigorously designed, elegantly coded, and
effectively tuned for performance
Basic Qualifications:
Bachelor's Degree
At least 3 years of experience in application development
(Internship experience does not apply)
At least 1 year of experience in big data technologies
Preferred Qualifications:
5+ years of experience in application development including Python,
SQL, Scala, or Java
2+ years of experience with a public cloud (AWS, Microsoft Azure,
Google Cloud)
3+ years experience with Distributed data computing tools (Kafka,
Spark, Flink)
2+ year experience working on real-time data and streaming
applications
2+ years of experience with NoSQL implementation (DynamoDB,
OpenSearch)
2+ years of data warehousing experience (Redshift or Snowflake)
3+ years of experience with UNIX/Linux including basic commands and
shell scripting
2+ years of experience with Agile engineering practices
At this time, Capital One will not sponsor a new applicant for
employment authorization, or offer any immigration related support
for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1,
TN, or another type of work authorization).
Capital One offers a comprehensive, competitive, and inclusive set
of health, financial and other benefits that support your total
well-being. Learn more at the Capital One Careers website.
Eligibility varies based on full or part-time status, exempt or
non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5
business days.No agencies please. Capital One is an equal
opportunity employer committed to diversity and inclusion in the
workplace. All qualified applicants will receive consideration for
employment without regard to sex (including pregnancy, childbirth
or related medical conditions), race, color, age, national origin,
religion, disability, genetic information, marital status, sexual
orientation, gender identity, gender reassignment, citizenship,
immigration status, protected veteran status, or any other basis
prohibited under applicable federal, state or local law. Capital
One promotes a drug-free workplace. Capital One will consider for
employment qualified applicants with a criminal history in a manner
consistent with the requirements of applicable laws regarding
criminal background inquiries, including, to the extent applicable,
Article 23-A of the New York Correction Law; San Francisco,
California Police Code Article 49, Sections 4901-4920; New York
City's Fair Chance Act; Philadelphia's Fair Criminal Records
Screening Act; and other applicable federal, state, and local laws
and regulations regarding criminal background inquiries.If you have
visited our website in search of information on employment
opportunities or to apply for a position, and you require an
accommodation, please contact Capital One Recruiting at
1-800-304-9102 or via email at
RecruitingAccommodation@capitalone.com. All information you provide
will be kept confidential and will be used only to the extent
required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting
process, please send an email to Careers@capitalone.com
Capital One does not provide, endorse nor guarantee and is not
liable for third-party products, services, educational tools or
other information available through this site.
Capital One Financial is made up of several different entities.
Please note that any position posted in Canada is for Capital One
Canada, any position posted in the United Kingdom is for Capital
One Europe and any position posted in the Philippines is for
Capital One Philippines Service Corp. (COPSSC).
Keywords: Capital One, The Colony , Senior Data Engineer (Python, SQL, Spark), IT / Software / Systems , The Colony, Texas
Click
here to apply!
|