Senior Big Data Engineer


Description

BizViz provides a 360 degree view of a business's data, serving any vertical and meeting the demanding needs of all business executives. With a 50+ strong team building the BizViz platform over several years, it is targeted at creating technological solutions that will give our customers the edge they need to succeed.

We strongly believe that our success lies in the success of our customers. We aim to build applications the way they envisioned, keeping each business' unique ideas and requirements in mind. We offer businesses a better alternative to using standard cookie-cutter ERP templates.

Job Summary

As a Big Data Engineer, you will be a member of a small, agile team of data engineers responsible for developing an innovative big data platform as a service for enterprises that need to manage mission critical data and diverse application stakeholders at scale. The platform manages data ingestion, warehousing, and governance, and enables developers to quickly create complex queries. The platform provides automatic scaling and elasticity to enable efficient use of resources, and provides services such as security, logging, and data provenance so that third party developers can focus their energy on algorithms rather than administration. We're looking for engineers who want a technical challenge. Help us improve the platform for our current customers and develop new capabilities for our future customers.

Responsibilities

  • Senior Big Data Engineer is an integral part of the Data Science Innovation team that works closely with Internal/External customer in all phases of the development.
  • Work with key stakeholders and understand their needs to develop new or improve existing solutions around data and analytics.
  • Work in a cross-functional, matrix organization, at times under ambiguous circumstances.
  • Partner in development of scalable solutions using large datasets with other data scientists on the team
  • Research innovative data solutions to solve real market problems.
  • Conceptualize, analyze and develop actionable recommendations for strategic challenges facing the organization.
  • Manage data analysis to develop fact-based recommendations for innovation projects.
  • Mine Big Data and other unstructured data to tap untouched data sources and deliver insight into new and emerging solutions.
  • Work with cross-functional teams to develop ideas and execute business plans.
  • Remain current on new developments in data analytics, Big Data, predictive analytics, and technology.

Education, Experience, Skills and Abilities Required for Consideration as a Candidate:

  • BTech/MCA degree or higher.
  • Minimum 5 year experience.
  • Candidates must be proficient in -
    • Java, Scala, Python
    • Apache Spark, Hadoop, Hive, Spark SQL, Spark Streaming, Apache Kafka
    • Well versed in various Predictive Algorithms, Mllib
    • Cassandra, RDMS (MYSQL, MS SQL, etc.), NOSQL, Columnar Databases, Big table.
  • Demonstrate a deep understanding of search engine technology. Ability to configure, index and maintain enterprise scale search applications. Proficient in writing custom handlers for Elasticsearch/Solr.
  • Agile development including Scrum and other lean techniques.
  • Excellent problem solving skills with the ability to design algorithms, which may include data cleaning, data mining, data clustering and pattern recognition methodologies
  • Ability to work cross-functionally in a highly matrix driven organization, at times under ambiguous circumstances
  • Personal qualities desired: creativity, tenacity, curiosity, and passion for deep technical excellence.

Location

Bangalore & Hyderabad.