top of page
istockphoto-464806966-612x612.jpg

Data Collection

The critical process in research, analysis, and decision-making across various fields, including science, business, and social sciences. It involves systematically gathering information from different sources to answer specific questions, test hypotheses, and evaluate outcomes. There are several methods of data collection, including surveys, interviews, observations, and experiments, each suited to different types of research and objectives.
 

Effective data collection ensures that the data is accurate, reliable, and relevant. This process involves several key steps: defining the objectives, selecting appropriate methods, designing data collection instruments, gathering the data, and finally, processing and analyzing it.

How And Why Data Engineers Need To Care About Data Quality Now - And How To Implement It
16:06

How And Why Data Engineers Need To Care About Data Quality Now - And How To Implement It

As companies look to incorporate AI and ML into their data strategies and roadmaps, there is a new opportunity to refocus on data quality. Regardless of how fancy or sophisticated a company's AI model might be, poor data quality will make the outputs of these models useless at best, and misleading and company destroying at worst. So, as your company is rolling out its internally developed LLM or implementing a dynamic pricing model, it’s a great time to review your data quality strategy. The first key point to cover is that data quality is not limited to one pillar, like accuracy. But instead, several key pillars need to be considered when developing your data quality system. Again, special thanks to decube for sponsoring this video! If you're looking to improve your data quality you can check out the link below https://bit.ly/3Sndk1B If you enjoyed this video, check out some of my other top videos. Top Courses To Become A Data Engineer https://www.youtube.com/watch?v=kW8_l57w74g Data Modeling Challenges - The Issues Data Engineers & Architects Face When Implementing Data Models https://youtu.be/G3m94JeuAtc If you would like to learn more about data engineering, then check out Googles GCP certificate https://bit.ly/3NQVn7V If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here. https://seattledataguy.substack.com/​​ Or check out my blog https://www.theseattledataguy.com/ And if you want to support the channel, then you can become a paid member of my newsletter https://seattledataguy.substack.com/subscribe Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio _____________________________________________________________ Subscribe: https://www.youtube.com/channel/UCmLGJ3VYBcfRaWbP6JLJcpA?sub_confirmation=1 _____________________________________________________________ About me: I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data. *I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you.
Explanation Of Data Governance & Data Quality || Difference Between Data Governance & Data Quality
10:06

Explanation Of Data Governance & Data Quality || Difference Between Data Governance & Data Quality

Explanation Of Data Governance & Data Quality || Difference Between Data Governance & Data Quality Lights OnData We often hear of data quality and data governance belonging together. That one cannot have good data quality without data governance. And that by doing data governance we achieve data quality. How so? What does that mean? What is the relationship between data governance and data quality? Or are they the same thing? --- If you'd like to enhance your data governance skills, enroll today in the Practical Data Governance: Implementation online course. Take it at your own pace and benefit from its available templates: https://www.lightsondata.com/practical-data-governance-implementation/?utm_source=youtube&utm_medium=video&utm_campaign=dgdq 0:00 Intro 0:40 What You Will Get Out Of This Video 1:11 What is Data Quality Management? 3:29 What is Data Governance? 4:55 Data Quality vs. Data Governance 7:04 Undercover Data Governance 7:59 Differences and Similarities 9:43 Conclusion ☕ If you found this content valuable and would like to support the channel, you can buy me a coffee: https://www.buymeacoffee.com/LightsOnData ********************************** My mission at LightsOnData is to: 1️⃣ Provide current and future data professionals with increased knowledge and a better understanding of data governance, data management, and data storytelling. 2️⃣ Provide simple, fun, and engaging, as well as thorough explanations, teachings, and advice on important, but otherwise boring and dry topics of the data world. 3️⃣ Put the lights on data-focused organizations and products by helping them get more exposure on social media. Here are ways that you can benefit from LightsOnData's content: 💡 ONLINE COURSES: Easy to learn, engaging, and highly valued online courses in areas of data governance, data management, and much more: https://www.lightsondata.com/courses 💡 LIGHTS ON DATA SHOW: Each episode highlights various data topics with renowned industry experts. Listen and watch the live show and podcast: https://anchor.fm/lightsondata https://www.lightsondata.com/lights-on-data-show 💡 FREE TEMPLATES: Check out our website for more helpful content, templates, best practices, definitions, etc. on data governance, data management, and data storytelling practices. https://www.lightsondata.com 💡 DAILY TIPS: Follow our LinkedIn page to benefit from daily content on data governance, data management, data quality, data storytelling, and all things data. https://www.linkedin.com/company/lightsondata 💡 FUN DATA SWAG: Show others your love for data with any of these fun apparel items and accessories: ********************************** 🎬Watch My Recent Videos🎬 🔶What is a Data Sub-Domain 🔗https://youtu.be/AwJ9a8nScHY 🔶How to Create a Data Visualization That Sticks 🔗https://youtu.be/VRUGrfAiz5A 🔶Fundamentals of Data Engineering 🔗https://youtu.be/eZ4pHe7OAe8 🔶How To Do Data Governance Better (Part 2) 🔗https://youtu.be/p90BiALbLNs 🌐 Visit Our Website: 👉https://www.lightsondata.com/data-merch Connect With George Firican On Social Media: 👉 Instagram 🔹https://www.instagram.com/lightsondata 👉Twitter 🔹https://twitter.com/georgefirican 👉LinkedIn 🔹https://www.linkedin.com/in/georgefirican 👉Pinterest 🔹https://www.pinterest.ca/f1309/data 👉Club House 🔹https://clubhouse.com/@lightsondata Thanks for watching the video from my channel. I really hope that you find this video to be extremely useful. If you have any inquiries, please post them in the comments section below. You also have the option of contributing your thoughts in the comments area. Join the Lights OnData community now. Don't Forget To Subscribe & Press The Bell Icon to get the latest updates. #data #datagovernance #dataquality #database #dataanalytics #datastructures #science #datastructures #ai #analytics #artificialintelligence data governance, data governance interview questions, data governance framework, data governance tutorial, data governance best practices, data governance tools, data governance analyst, data governance explained, data governance collibra, data governance in healthcare, data governance strategy, data governance policy, data governance maturity model, data governance operating model

Understanding Data Collection Methods

Comprehensive Knowledge of Methods

  • Surveys: Learn the design and administration of structured questionnaires, using tools like online survey platforms. Understand sampling techniques to ensure representative data.

  • Interviews: Master the art of conducting structured, semi-structured, and unstructured interviews. Learn to formulate open-ended questions that elicit detailed responses.

  • Observations: Understand participant and non-participant observation methods. Learn to systematically record behaviors and events in natural settings.

  • Experiments: Gain knowledge of experimental design, including control groups, randomization, and variable manipulation to establish causal relationships.

Appropriate Method Selection

  • Learn to align data collection methods with research objectives, whether quantitative or qualitative. Understand the strengths and limitations of each method in different contexts.

Ensuring Data Quality and Integrity

Designing Reliable Instruments

  • Learn to construct well-designed questionnaires and interview guides that minimize ambiguity and bias. Use pilot testing to refine instruments.

  • Understand scale construction, including Likert scales, and methods to test reliability (e.g., test-retest reliability) and validity (e.g., content validity).

Minimizing Bias and Errors

  • Master techniques to reduce sampling bias through proper sample size determination and random sampling methods.

  • Learn to identify and mitigate measurement errors, such as response bias and interviewer bias, by employing standardized procedures and training data collectors.

Ensuring Accuracy and Consistency

  • Develop skills in data verification and validation techniques to ensure data accuracy. Learn to use statistical methods to detect and address outliers and inconsistencies.

  • Implement data coding protocols and data entry procedures to maintain data integrity throughout the collection process.

Ethical and Legal Considerations

Ethical Principles

  • Understand the importance of informed consent, ensuring participants are fully aware of the study's purpose, procedures, risks, and benefits before participation.

  • Learn to maintain participant confidentiality and anonymity, using techniques like data anonymization and secure data storage.

Legal Requirements

  • Familiarize yourself with relevant data protection laws and regulations, such as the General Data Protection Regulation (GDPR) and the Health Insurance Portability and Accountability Act (HIPAA).

  • Understand the requirements for ethical review and approval from institutional review boards (IRBs) or ethics committees.

Implementing Ethical Practices

  • Develop strategies to handle sensitive data ethically, ensuring respectful and non-intrusive data collection methods.

  • Learn to manage and mitigate potential ethical dilemmas that may arise during the data collection process, maintaining the integrity and trustworthiness of the research.

bottom of page