#KeyNote #DataScience #Methodology #DataMining

Data Science Methodologies

What is CRISP-DM(Cross industries - Data Mining)?

The CRISP-DM methodology is a process aimed at increasing the use of data mining over a wide variety of business applications and industries. The intent is to take case specific scenarios and general behaviors to make them domain neutral. CRISP-DM is comprised of six steps with an entity that has to implement in order to have a reasonable chance of success.

The six steps are shown in the following diagram:

1. Business Understanding:- This stage is the most important because this is where the intention of the project is outlined. Foundational Methodology and CRISP-DM are aligned here. It requires communication and clarity. The difficulty here is that stakeholders have different objectives, biases, and modalities of relating information. They don’t all see the same things or in the same manner. Without clear, concise, and complete perspective of what the project goals are resources will be needlessly expended.

2. Data Understanding:- Data understanding relies on business understanding. Data is collected at this stage of the process. The understanding of what the business wants and needs will determine what data is collected, from what sources, and by what methods. CRISP-DM combines the stages of Data Requirements, Data Collection, and Data Understanding from the Foundational Methodology outline.

3. Data Preparation:- Once the data has been collected, it must be transformed into a useable subset unless it is determined that more data is needed. Once a dataset is chosen, it must then be checked for questionable, missing, or ambiguous cases. Data Preparation is common to CRISP-DM and Foundational Methodology.

4. Modeling:- Once prepared for use, the data must be expressed through whatever appropriate models, give meaningful insights, and hopefully new knowledge. This is the purpose of data mining: to create knowledge information that has meaning and utility. The use of models reveals patterns and structures within the data that provide insight into the features of interest. Models are selected on a portion of the data and adjustments are made if necessary. Model selection is an art and science. Both Foundational Methodology and CRISP-DM are required for the subsequent stage.

5. Evaluation:- The selected model must be tested. This is usually done by having a pre-selected test, set to run the trained model on. This will allow you to see the effectiveness of the model on a set it sees as new. Results from this are used to determine efficacy of the model and foreshadows its role in the next and final stage.

6. Deployment:- In the deployment step, the model is used on new data outside of the scope of the dataset and by new stakeholders. The new interactions at this phase might reveal the new variables and needs for the dataset and model. These new challenges could initiate revision of either business needs and actions, or the model and data, or both.

CRISP-DM is a highly flexible and cyclical model. Flexibility is required at each step along with communication to keep the project on track. At any of the six stages, it may be necessary to revisit an earlier stage and make changes. The key point of this process is that it’s cyclical; therefore, even at the finish you are having another business understanding encounter to discuss the viability after deployment. The journey continues.

For more information on CRISP-DM, go to: IBM Knowledge Center – CRISP-DM Help Overview

“Python 3.9.0 is the newest feature release of the #python3 language” that comes with numerous features, and optimizations.

Hands-On Genetic Algorithms with Python (2020)
Автор: Eyal Wirsansky

📊 How is Machine Learning used in the LinkedIn Recruiter Recommendation System

@epythonlab

Learn new libraries of Python 3.9.0 https://docs.python.org/3/library/stdtypes.html
@epythonlab

Here is remote intern in different positions including #DataScience
Share it @epythonlab

https://www.linkedin.com/feed/update/urn:li:activity:6721763846954078208/

#ChallengeMersenneNumber #DataStructure #List #ProgramFlow #Python

- A Mersenne number is any number that can be written as 2^p - 1 for some p. For example, 3 is a Mersenne number (2^2 - 1) as is 31 (2^5 - 1).

- Write a function that accepts an exponent p and returns the corresponding Mersenne number.

Note: Mersenne numbers can only be prime if their exponent, p, is prime. Make a list of the Mersenne numbers for all primes p between 3 and 65 (there should be 17 of them).

Hint: It may be useful to define the is_prime and get_primes functions for use in this problem.

N.B: define a function that accepts an exponent and returns the corresponding Mersenne number. Test the execution time of your algorithm before submitting to this challenge.

Prize: Top 3 winners will gain access to this channel
Direction:- Post your solution @pythonethbot

Dear members, does this challenge really hard? Only one member tried yet. Do you want the solution? If yes, choose the way I deliver the solution. Let's know now.
anonymous poll

In video – 16
👍👍👍👍👍👍👍 62%

In code only(text form) – 10
👍👍👍👍 38%

👥 26 people voted so far.

Create GUI Applications with Python & Qt5 (2020)

@epythonlab

Sorry, this is the bot you can send your feedback and solutions @EPYTHONLABBOT

Python Programming for Absolute Beginners

You don't need previous knowledge of Computer Programming

You can start learning now from scratch.


Subscribe to the YouTube Channel and receive all video tutorials from the scratch

https://youtu.be/cChdA70hnaU
Also find resources at https://t.me/epythonlab

#ChallengeAbsoluteDifference #Algorithm #DataStructure #Loop #Array

Consider an array of integers, arr[0], arr[1] ... arr[n-1]. We define the absolute difference between two elements, arr[i] and arr[j] (where i != j), to be the absolute value of arr[i] - arr[j]

Given an array of integers, find and print the minimum absolute difference between any two elements in the array. For example, given the array arr=[-2, 2, 4] we can create 3 pairs of numbers: [-2, 2], [-2, 4], and [2, 4] . The absolute differences for these pairs are |(-2)-2|=4, |(-2)-4|=6, and |2-4|=2 . The minimum absolute difference is 2.

Q: Define the minimumAbsoluteDifference function which has a parameter arr. It should return an integer that represents the minimum absolute difference between any pair of elements.
Post your solution @EPYTHONLABBOT

Hands-On Data Analysis with Pandas (2019)

@epythonlab