Understanding Big Data Developers

Read original DZone research on the habits, preferences, and wants of Big Data developers.

Big Data developers are extremely important. They help companies make smarter business decisions, update processes, drive profits, and create and keep happy customers.

Their data scientist-y thinking combined with programming and coding skills makes big data developers unique, and necessary if organizations want to fully understand the data they’re capturing.

In preparation of our upcoming Research Guide, the DZone Guide to Big Data: Data Science and Advanced Analytics, we surveyed the DZone audience to understand the habits, preferences, and needs of Big Data developers and software professionals.

Our initial survey research shows that:

  • R (60.6%) and Python (62.8%) are the most common languages/libraries/frameworks used for data science and machine learning.
  • The biggest challenge in data science is unsanitized data.
  • Agile is the most common project management methodology used in data science projects.
  • 78.4% say Java is the programming language ecosystem their company uses.
  • 30.4% says their Immediate team size is between 6-10 people.
  • Big Data professionals are experienced, with 36.1% having 15+ years of professional experience.

Another interesting tidbit: 82.6% say reading articles on various tech sites is their preferred method of learning and keeping up-to-date on the industry.

Big Data developer preferred learning channels

The Guide, released on April 24th, also covers survey research on tools and frameworks Big Data developers recommend and use, pain points associated with big data, common data set sizes, and more.

Big Data Professionals on DZone

To get even more perspective on our Big Data audience, we dove into our database and found out the following:

  • The majority of our Big Data readers are male – 81.55%.
  • They’re located across the globe: United States, United Kingdom, Germany, Canada, Brazil, France, and India.
  • They’re between the ages of 25-34 – 42.07%.
  • They prefer tutorial (40.75%) and opinion (28.47%) type articles.
  • They’re interested in cars, financial services, real estate, security, and productivity software, and travel.

The Future of Big Data, According to Execs

Our own Research Analyst, Tom Smith, spoke with 22 executives from 20 companies to understand the challenges, opportunities, and changes in the Big Data industry.

Here are some takeaways from his interviews:

  • Big data is evolving. How can you take advantage of the data you have? Are their opportunities for your company to make a difference?
  • There is not enough emphasis on security and reliability. Not enough emphasis on where data is coming from and how to keep it safe and clean.
  • Prepare for the adoption of the cloud when constructing the architecture where data will live.
  • Help people understand customers better by analyzing buyer behavior and web metrics.
  • Having the right people is huge. We have a qualified candidate crisis. Data scientists must keep their skills at cutting edge and know what tools are evolving to solve their problems.

You can read all of Smith’s insights below:

Big Data Concerns

Big Data: Additional Considerations

Big Data Opportunities

Big Data Solves Real-World Problems

Issues Preventing Big Data Success