Software Engineer, Log/Big Data Processing

Software Engineer, Log/Big Data Processing

Byte Dance
Singapore
Not Specified
Not Specified

Job Description


Responsibilities
Founded in 2012, ByteDance is a technology company operating a range of content platforms that inform, educate, entertain and inspire people across languages, cultures and geographies. With a suite of more than a dozen products, including TikTok, Douyin and Toutiao. ByteDance now has a portfolio of applications available in over 150 markets and 75 languages. The AIOPS intelligent monitoring team is responsible for the construction of ByteDance's entire monitoring ecosystem including intelligent monitoring and alarming. Our work involves the life cycle management of massive PB-level data, promoting the construction of online stability assurance, fault diagnosis, capacity management, and service governance capabilities. Responsibilities 1. Design and develop big data platforms for log services 2. Design and develop the entire pipeline for service invocation 3. Build the next-generation time series index storage engine.
Qualifications
Requirements 1. Bachelor's degree or above in computer science, software engineering, or a related field 2. Proficiency with common Linux commands and languages such as Java/Go/Python/C++ 3. Experience with the industry's advanced monitoring system such as CAT/Apache SkyWalking/OpenTracing/OpenCensus 4. Familiar with at least one tool or framework related to big data processing such as Hadoop, MapReduce, Hive, Storm, Spark, Kylin, Scribe, Kafka, Hbase, Canal, Sqoop, etc. 5. Strong coding and troubleshooting capabilities, and enthusiastic about learning new technologies. Preferred 1. Participation in big data and massive log processing projects 2. Experience with secondary development, application, and tuning of indexing services such as Elasticsearch, Lucene, Solr, etc.

Job Details

Employment Types:

Industry:

Function:

About Byte Dance

Similar Jobs

People Also Considered

Career Advice to Find Better

Simple body text this will replace with orginal content