Ref #2633: Data Engineer in New York, NY
The Software/Data Engineer will play a significant role in the design, implementation, and continuous improvement of this and other key data products and pipelines. This role will be working with GCP using core data warehousing tools and big data related technologies as well as full-stack Python development.
- Enterprise experience with GCP Big Data products including BigQuery, Pub/Sub, Cloud Composer, Dataflow, Dataproc, Dataprep, Data Studio, Bigtable, Cloud Storage, and more.
- Understand different types of storage (filesystem, relational, NoSQL) and working with various kinds of data (structured, unstructured, metrics, log files, etc.)
- Experience with data pipelines (ETL, ELT) and data wrangling procedures using Python and SQL.
- At least 3-5 years experience as a software or data engineer.