Software Engineer II
The World’s information is doubling every two years with 1.8 Zetabytes (1,800,000 petabytes) created and replicated in 2011. The scale was unimaginable a few years back. The potential of the insights we can get out of this data is expanding equally fast. This requires us to push the limits of our data platforms and go beyond the traditional models of storage and compute. Microsoft is embracing Apache Hadoop to enable applications to process petabytes of data using thousands of processing nodes, on both Windows Azure and Windows Server. With the emergence of distributed query, storage, analytics and execution runtimes such as MapReduce, HiveQL, PigLatin, Dryad and others, many customers on premise and on cloud are looking for ways to build scalable insight with the lowest latency and highest quality. Our solution will enable a killer experience based on the core Hadoop technologies combined with the Microsoft stack, by tying together key Microsoft assets such as Office, .NET and the SQL Server suite of products. We are building a service from ground up to provide this experience in Azure. We plan to contribute back to the Apache Software Foundation and become active participants in that part of the open source software community.
Joining the HDInsight team in the SQL Data Services organization is a fantastic opportunity to work with some of the best engineers in the industry who are tackling challenges that will continue to shape the industry. SQL Data Services group fosters a supportive and productive work environment and is known for providing growth avenues for developers to reach the highest levels at Microsoft. The team culture values engineering quality, technical excellence, and grass roots innovation.
As a SOFTWARE DEVELOPMENT ENGINEER on the HDInsight Development team, you will work and collaborate with a team of talented senior and junior engineers to design and deliver on our next set of big challenges. You will be responsible for building the core Microsoft Hadoop platform both on Windows Server and Windows Azure. This includes a broad range of areas such as the security, Hadoop performance, .NET tooling, query optimization, service fundamentals, management and portal UI. Opportunities exist to work on any or all of them.
Basic Qualifications:
BS degree in Computer Science (or equivalent) is required, M.S./Ph.D. preferred
4+ years of software development experience working in native or managed code environments.
The ideal candidate would have:
Demonstrated ability in cloud platform development or enterprise server development is required.
Experience with databases, distributed systems, Cloud and Big Data technologies is a big plus, but not required.
Strong problem-solving and C/C++/C#/Java coding skills. - Big pluses, but not requirements.
Experience with Cloud and Big Data technologies such as Hadoop, MapReduce, Amazon EC2, Azure
Strong Knowledge in distributed systems, databases, query processing, query, cloud computing, operating systems
If you are looking for an exciting change in your career, we have a great set of opportunities available.
Development (engineering)