Reinvent Product Management Skills with Data-Driven Diplomacy

How to collect data and analyze it?

5 min read

Data Collection Strategies

Starting broad and then narrowing down is a helpful method for data collection. By beginning with a wide scope, you capture all relevant information without prematurely excluding important details. This comprehensive approach allows you to build a detailed understanding of preferences and needs. Once you have gathered a broad data set, you can then focus on the most critical aspects.

Example Context: Collecting customer feedback on a new smartphone model.

Action Steps:

1. Broad Collection:

- Gather feedback from various sources, such as surveys, social media comments, customer service interactions, and online reviews.

- Example: Collect 10,000 survey responses, 5,000 social media comments, 2,000 customer service logs, and 3,000 online reviews.

2. Narrow Down:

- Identify common themes and issues mentioned by customers.

- Example: Find that battery life and camera quality are the most frequently mentioned aspects.

3. Analyze:

- Focus on the most frequently mentioned features and problems to understand customer preferences and needs.

- Example: Analyze data to find that 60% of users are satisfied with battery life but 40% have issues with the camera.

Identifying and Using Data Sources

To start collecting data on market and customer preferences, brainstorm and list all possible sources. This can include both traditional and new methods. Some initial data sources to consider are public data available on the internet, market research reports, customer surveys, social media analysis, financial statements, and customer reviews.

Example Context: Gathering data on customer preferences for the new smartphone.

Action Steps:

1. Brainstorm Sources:

- List all potential sources of feedback, such as tech forums, product review websites, social media platforms, and customer surveys.

- Example: Identify sources like Reddit, TechCrunch, Twitter, Facebook, and email surveys.

2. Collect Data:

- Gather information from these sources to get a comprehensive view of customer opinions.

- Example: Collect 5,000 comments from Reddit, 3,000 reviews from TechCrunch, and 2,000 Twitter mentions.

3. Internet Searches:

- Search for articles and reports on smartphone trends and customer reviews.

- Example: Find 10 industry reports and 20 articles on the latest smartphone trends.

Conducting Surveys and Understanding Preferences

Conducting surveys is essential for collecting relevant data, but it comes with challenges. Effective surveys need to be well-designed to ensure the data collected is useful. Key steps in gathering data from users include identifying your target users, designing clear and relevant surveys, engaging directly with users through interviews or focus groups, analyzing the collected data to find patterns, and complementing this with secondary data from public sources and social media.

Example Context: Creating and conducting surveys to gather feedback on the new smartphone.

Action Steps:

1. Identify Target Users:

- Segment your customer base (e.g., by age, usage habits).

- Example: Segment users into groups like teenagers, professionals, and seniors.

2. Design Surveys:

- Create clear and relevant survey questions about smartphone features, usability, and satisfaction.

- Example: Design a survey with questions on battery life, camera quality, and overall satisfaction.

3. Engage Users:

- Conduct surveys through email, social media, and in-store interactions.

- Example: Send out 10,000 email surveys, post survey links on social media, and set up survey stations in 50 stores.

4. Analyze Data:

- Look for patterns in the responses to understand what customers like and dislike.

- Example: Analyze survey responses to find that 70% of professionals prioritize battery life while 60% of teenagers focus on camera quality.

5. Complement with Secondary Data:

- Use data from tech forums and social media to supplement survey findings.

- Example: Compare survey results with 2,000 comments from tech forums to validate findings.

Combining Data Sources

Direct user engagement provides specific insights often missing from secondary sources. By combining direct feedback with data from other sources like public services or social media, you can validate your findings and get a more comprehensive view of user preferences and behaviors.

Example Context: Combining survey results with social media feedback for the new smartphone.

Action Steps:

1. Engage Directly:

- Collect detailed feedback from customers through surveys and interviews.

- Example: Conduct 100 in-depth interviews and gather 10,000 survey responses.

2. Combine Data:

- Integrate this feedback with social media comments and online reviews.

- Example: Merge survey responses with 5,000 social media comments and 3,000 online reviews.

3. Validate Findings:

- Cross-reference the information to confirm trends and preferences.

- Example: Confirm that both surveys and social media indicate issues with the camera quality.

4. Comprehensive View:

- Develop a full understanding of customer preferences and issues.

- Example: Conclude that camera quality and battery life are the top concerns based on all data sources.

Predicting Consumer Behavior

Determining when people are ready to get a new product can be challenging. Changes in behavior, such as increased activity and engagement on a website, can provide signals. While many purchases happen spontaneously, engagement data can help predict readiness to buy.

Example Context: Predicting when customers are ready to buy the new smartphone.

Action Steps:

1. Monitor Behavior:

- Track website activity, such as visits to the product page and time spent on the site.

- Example: Notice that users who visit the smartphone page five times are more likely to buy.

2. Identify Patterns:

- Look for signs of readiness, such as multiple visits to the smartphone’s page or adding the product to the cart.

- Example: Find that users who add the phone to their cart twice are 80% more likely to purchase.

3. Use Data:

- Utilize this engagement data to predict when a customer is likely to purchase.

- Example: Predict that users who spend more than 10 minutes on the product page are ready to buy.

4. Track Metrics:

- Focus on email engagement, session durations, and review lookups.

- Example: Track that users who open marketing emails and click on links are 50% more likely to convert.

Challenges and Benefits of Predictive Analytics

Predicting individual behavior is harder than predicting aggregate trends because individual actions are influenced by numerous personal factors. Aggregate trends, however, show broader patterns that can be analyzed statistically. Analyzing engagement data helps companies identify patterns that lead to conversions. For example, frequent engagement with emails, spending time on product pages, and looking up reviews suggest a higher likelihood of conversion.

Example Context: Using predictive analytics to understand customer behavior for the new smartphone.

Action Steps:

1. Analyze Trends:

- Look at aggregate data to identify broader buying patterns.

- Example: Find that overall, users visit the smartphone page three times before buying.

2. Statistical Methods:

- Apply statistical analysis to predict future behaviors.

- Example: Use regression analysis to predict that a 10% increase in email engagement leads to a 5% increase in purchases.

3. Track Engagement:

- Monitor email opens, click rates, and session durations to identify potential buyers.

- Example: Track that users who open emails and spend over five minutes on the site are 70% more likely to buy.

4. Forecast Behaviors:

- Use predictive analytics to make data-driven decisions on marketing strategies.

- Example: Predict that increasing personalized email campaigns will boost conversions by 15%.

Data Quality for Predictive Analysis

Good data for predictive analysis is characterized by its quality, completeness, and timeliness. High-quality data is accurate and reliable, complete data covers all relevant aspects, and timely data is up-to-date and reflects current conditions. These attributes are essential for making accurate predictions.

Example Context: Ensuring quality data for predictive analysis of the new smartphone.

Action Steps:

1. Verify Accuracy:

- Check the data for accuracy and reliability.

- Example: Validate that 95% of customer feedback accurately reflects their experiences.

2. Ensure Completeness:

- Make sure the data covers all relevant aspects of customer feedback.

- Example: Ensure feedback includes comments on all key features like battery, camera, and usability.

3. Timely Data:

- Use the most current data available to reflect real-time conditions.

- Example: Use feedback from the latest month to ensure insights are up-to-date.

4. Regular Updates:

- Continuously update the data to maintain its relevance and accuracy.

- Example: Regularly update the database with new customer reviews and feedback every week.