Get the data, land it in Hadoop. This isn’t the Kimball school of data management, and it’s not a super expensive kit. Get the data, stick it in Hadoop, keep it forever. If it’s not there it won’t get used. Your analytical models and algorithms might just need it.
Open up access to new data sources to your subject matter experts and then work together to test, learn and iterate on structuring the data so it’s useful for analysis and business outcomes. You don’t need to model the whole lot upfront. You can go further and purely do schema on reading, but this depends on your target audience.
It’s not a field of dreams – don’t do this. However, do get ahead of the problem and build for yet unstated requirements. Alongside this, though you must build credibility, communicate what’s possible and bring the business and analytics parts of the business along with you so the platform gets utilised.
Create a well-rounded team with all the skills necessary. You don’t need and you won’t find a mythical god that can do everything needed; a mix of skills, mix of experience, commercial, technical, consultative folk. A team to be proud of and you would trust to engage with all stakeholders and make you proud.
Prove you can do something different from the BI projects that you’ve tried to deliver before. Demonstrate capability. Do lunch and learns. Do show and tells. Become an internal marketer. Its possible with Hadoop to get value from data far quicker than was previously possible so find a valuable use case, work with the owner and create that beachhead example of whats possible.
The secret 6th trick is to make sure you have decent data management, discovery and analytics tools to integrate with Hadoop to create a window on to your data. The easier it is to work with, the more people will come begging for more.
That’s all you need to know in a Hadoop guide. It’s about people, culture, ways of working and some tech thrown in to boot.