Recently my mac book ran out of service while I was at the middle of learning “Machine Learning”. For emergency purpose I had to buy a low configured windows machine with Windows 10 (32 bit) pre-installed. I thought why shouldn’t I try learning ML on this computer and see it’s limit. I was able to run most of the ML algorithms from logistic regresion, classification, and even NLP (National Language Processing). At the very end of my learning, I faced problem to install XGBoost on windows. However, finally I was able to manually install it and run my script successfully. Today I’ll show you how did I overcome this problem in 3 steps.
Step 1 – Gather information
Python Version: Open command prompt and run following command to get version of python that installed on your system
> python –version
System Architecture: Go to desktop and right click on “My computer or This PC” icon. From context menu select properties. System window will appear with all the information related to your system. Note down whether the operating system is 32 bit or 64 bit.
Step 2: Download windows binary file for XGBoost
Visit https://www.lfd.uci.edu/~gohlke/pythonlibs/
Many libraries are listed in this page. Find and search for XGboost section. In XGBoost section, you will see a list of binary files. Download the one that best matches your system architecture (64 bit or 32 bit) and python version. For example, xgboost‑0.72‑cp37‑cp37m‑win32.whl
binary package is suitable for python version 3.7 and windows 32 bit operating system. Here, cp37 indicates the python version 3.7 and win32 stands for windows 32 bit architecture.
Step 3: Install XGBoost on windows
Finally, it is time to install XGBoost on windows system.
1. Open command prompt in Administrator mode (Find Command Prompt in your menu, right click on the menu and click Run as Administrator)
2. cd to the folder where you downloaded XGBoost binary file
2. Run the following command:
> pip install xgboost‑0.72‑cp37‑cp37m‑win32.whl
If the installation fails due to any missing dependency, install them and re-run the pip install command.
Now, check whether XGBoost installed on your computer by using following command:
python
import xgboost
If XGBoost is not installed properly, then you will see an error message.
Filezilla is a popular desktop software that we use to upload files on server using FTP protocol. Because it’s user interface is user friendly and you can upload any file by just drag and drop method. Now the question is, how can we upload files on AWS ec2 server using this software. Because ec2 instance doesn’t have any password to logon. Instead, it has a private key that you can download from ec2 dashboard. Let’s figure out how to upload file on aws ec2 instance using FileZilla.
Prerequisite:
Before starting, we assume that you have the following things in your hand.
One ec2 server up and running
You have it’s host address or Public IP address
You have it’s private key in PPK format
FileZilla installed on your local computer
Note for prerequisite #2: Most likely you have private key in pem format instead of ppk format. To convert a pem private file to ppk you can use putty software. Putty can be installed on both windows and linux computer. For more information to convert the file click here.
Important note for prerequisite #2: Make sure that, the private key file’s permission is set to 400.
Login and upload file on AWS ec2 instance using FileZilla
FileZilla Site Manager
Open Filezilla
Open site manager (File > Site Manager or Ctrl + S)
Click on New Site Button from bottom right corner of Site Manager dialog box.
Enter the site name whatever you wish (I named it AWS_Training)
On the right side of the dialog box, you will see a box with label Host: Enter public IP or host address of the ec2 instance
From protocol dropdown box, select “SFTP – SSH File Transfer Protocol”
In Logon Type dropdown box select “Key file”
In User text box, type ec2-user
Below user textbox, you can see a box named Key file. Here you press Browse button (left size of the box) and select the private key file in ppk format.
Now press Connect. If everything goes okay, then you can successfully login to the ec2 instance and upload file
Press okay to come out of the Site Manager dialog box
Now you can use this site configuration to login and upload files on ec2 instance.
TLDR: “Logistic regression is a classification algorithm. It classifies data into different classes.”
We can classify a bird based on it’s independent variables such as color, size etc by using logistic regression.
Suppose you have lot of emails in your inbox. However, your personal mail server does not have any email spam filtering system. So you have to build a system that can filter your emails and classify as spam or not.
You can classify an email as spam by using some parameters or variables. These variables are called independent variables. For example, you may say that if the email is coming from this particular email address then it is spam. Or if this email is coming from that particular IP address or server then it’s spam. Another variable or parameter can be a “list of words”. If these words are present in your email’s subject or email’s body then you can identify the email as spam.
By using these independent variables we can find out the dependent variable – “spam”. Using independent variables we find out dependent variable with help of an algorithm. This algorithm is called Logistic regression.
When to use Logistic regression:
If you can answer using YES or NO to your questions, then you can apply logistic regression.
For example:
Is the email spam? Yes / No;
Do the symptoms (independent variables) have risk of potential heart attack? Yes / No;
Is the transaction fraud? Yes / No;
By this way, you can find out when to use Logistic regression.
When you start to learn linear regression and Logistic regression you will come up with an equation. The equation will contain theta. You might be wondering what does this theta in machine learning mean.
A few days ago I was in my EMBA class “Managing Operations”. our class topic was forcasting. In that class I learned something about weights. Later I was able to relate between weights and theta. Today I will explain what is theta in terms of weights.
Suppose you have an online store where you sell expensive, unique and stylus pens. In last year you advertised on Google AdWords, Facebook, Twitter and a local newspaper. From last year’s data you have come to know that Google advertisement was more effective than all other advertisements. This year you have to make a plan for advertising on different media. To get a better result what will you do?
Simple answer: You will spend more money on Google advertisement. From your previous year’s data you have found that Facebook is in second position. So your second priority will be Facebook advertisement. You have advertised on your local newspaper too. However, you couldn’t figure out how much traffic did you get from that advertisement. So this year you are not going to advertise on local newspaper at all.
Let’s assume, your this year’s total advertisement budget is US$ 6000. We can write down your this year’s advertisement plan as follows:
$3000 Google advertisement + $2000 Facebook advertisement + $1000 twitter advertisement + $0 Local newspaper advertisement = $6000.
From above calculation we can say that we are spending most of the money in Google advertisement. Alternatively, we can say most weight goes to Google advertisement. So by using weights you give different priority to different media.
Now you understood what does it mean by weight. If so then you also understand the meaning of theta in machine learning. In machine learning algorithms we use theta in different features to give them different priority or weight based on their importance.
House price example
When we do linear regression and Logistic regression we use some features. For example, suppose we are going to find out house price of any specific area. For that we take some historical value or previous selling price data. From that data we take different features of house. e.g. number of rooms, number of bathrooms, kitchens and whether the house is beside the main road or far from the main road.
For calculating house price we give more priority to some features and less priority to some other features. For example, number of rooms have more weight or priority than number of kitchens. If there are 5 kitchens in a 2000 square feet home, that may not add more value to the house. Because only one or two kitchens are enough. That’s why number of kitchens are not major issues in predicting house price. So we give less weight to kitchen and more weight to rooms as well as total area of the house.
So now if you see a machine learning algorithm with theta, you will be able to figure out what does it mean.
Almost all mobile applications need to save different type of data in local storage or cache. It is true for Android native app, iOS native app and even hybrid cordova app. Today I’ll show you, how to save data in Ionic Framework in local storage.
It will take about 15 minutes to complete the project. After finishing the project you will be able to save and get both Json Object and plain string data from local storage.
Create a new application :
1
$ionic start my_db_project blank
Move to your application’s root folder and add native storage cordova plugin:
1
2
$ionic cordova plugin add cordova-sqlite-storage
$npm install--save@ionic/storage
Make it available in your app.module.ts file:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
import{IonicStorageModule}from"@ionic/storage";
...
@NgModule({
...
providers:[
...
Storage
...
]
...
})
exportclassAppModule{}
Create a new provider:
1
$ionicgprovider storage-dao
Open the provider and add following code:
JavaScript
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
import{Injectable}from'@angular/core';
import'rxjs/add/operator/map';
import{Storage}from"@ionic/storage";
/*
Generated class for the StorageDaoProvider provider.
See https://angular.io/docs/ts/latest/guide/dependency-injection.html
Reinforcement learning is one type of Machine learning. In a single sentence, in this learning process a machine learns using trial and error method. Here basically, we give the machine 2 instructions.
1. Try all possible ways.
2. From your experience avoid errors and increase success rate.
Suppose, we have a robot. There is a fire in front of it. The robot can do 2 things. Whether it can directly jump into the fire or run away from it.
At first it will try both ways. Jump into fire and fail. Then again it will run away and survive. The robot will remember it. Next time when it see the fire again, it will run away. This is the basic concept of reinforcement learning.
Reinforcement learning Algorithms:
Q-Learning
SARSA (State–action–reward–state–action)
Relative value learning (R-Learning)
Where to apply:
There are many fields where we can apply it. Some examples are as follows:
Playing a game: Reinforcement learning can learn to play different games and can become master on it. One great example is “AlphaGo system”. Using this machine learning the system beat a high ranked Go player.
Natural language processing: Processing human language is very difficult task. By using it we are overcoming this issue.
Self driving car system: In the near future, we’ll see lot of self driving cars on the road. To make it come true reinforcement learning is contributing a lot. ML algorithms (e.g. Deep Q-Learning algorithm) are used in self driving car system to improve driving.
Robot’s movement: Robot’s different movements are improved over time by using reinforcement learning. For example, robot can grab an object more accurately by using this algorithm.
This is 2nd part “Machine Learning Interview Questions”. To read the first part of this series, click here
What are the pros and cons (advantages and disadvantages) of Bayes’ Theorem?
Pros: 1. Bayes’ theorem is relatively simple to understand and build, 2. We can train it easily; even with a small data set, 3. It’s fast!, 4. It’s not sensitive to irrelevant features. Cons: 1. It assumes every feature is independent, which isn’t always the case
Cluster analysis or clustering is the task of grouping a set of objects in such a way that objects in the same group (called a cluster) are more similar (in some sense or another) to each other than to those in other groups (clusters). It is a main task of exploratory data mining, and a common technique for statistical data analysis, used in many fields, including machine learning, pattern recognition, image analysis, information retrieval, bioinformatics, data compression, and computer graphics.
In signal processing, independent component analysis (ICA) is a computational method for separating a multivariate signal into additive subcomponents. This is done by assuming that the subcomponents are non-Gaussian signals and that they are statistically independent from each other. ICA is a special case of blind source separation. A common example application is the “cocktail party problem” of listening in on one person’s speech in a noisy room.
Deep learning, a subset of machine learning, utilizes a hierarchical level of artificial neural networks to carry out the process of machine learning. The artificial neural networks are built like the human brain, with neuron nodes connected together like a web. While traditional programs build analysis with data in a linear way, the hierarchical function of deep learning systems enables machines to process data with a non-linear approach. A traditional approach to detecting fraud or money laundering might rely on the amount of transaction that ensues, while a deep learning non-linear technique to weeding out a fraudulent transaction would include time, geographic location, IP address, type of retailer, and any other feature that is likely to make up a fraudulent activity.
1. Automatic speech recognition, 2. Image recognition, 3. Visual Art Processing, 4. Natural language processing, 5. Drug discovery and toxicology, 6. Customer relationship management, 7. Recommendation systems, 8. Bioinformatics, 9. Mobile Advertising
What is random forest?
Random forests or random decision forests[1][2] are an ensemble learning method for classification, regression and other tasks, that operate by constructing a multitude of decision trees at training time and outputting the class that is the mode of the classes (classification) or mean prediction (regression) of the individual trees. Random decision forests correct for decision trees’ habit of overfitting to their training set.
What do you know about Dimensionality Reduction Algorithms?
In machine learning and statistics, dimensionality reduction or dimension reduction is the process of reducing the number of random variables under consideration,[1] via obtaining a set of principal variables. It can be divided into feature selection and feature extraction.
TensorFlow is an open-source software library for dataflow programming across a range of tasks. It is a symbolic math library, and also used for machine learning applications such as neural networks.[3] It is used for both research and production at Google.
What is data mining?
Data mining is the process of sorting through large data sets to identify patterns and establish relationships to solve problems through data analysis. Data mining tools allow enterprises to predict future trends.
Use test data for evaluation or do cross validation. Add regularizations terms (such as L1, L2, AIC, BIC, MDL or a probabilistic prior) to the objective function.
In machine learning, kernel methods are a class of algorithms for pattern analysis, whose best known member is the support vector machine (SVM). The general task of pattern analysis is to find and study general types of relations (for example clusters, rankings, principal components, correlations, classifications) in datasets. kernel methods require only a user-specified kernel, i.e., a similarity function over pairs of data points in raw representation.
Will machines ever be able to feel consciousness. What do you think?
Answer based on your own preference
What is apache spark?
Apache Spark is a powerful open source processing engine built around speed, ease of use, and sophisticated analytics. It was originally developed at UC Berkeley in 2009
What is the difference between hash table and array?
1) Hash table store data as name, value pair. While in array only value is store. 2) To access value from hash table, you need to pass name. While in array, to access value, you need to pass index number. 3) you can store different type of data in hash table, say int, string etc. while in array you can store only similar type of data.
What are some of the major tasks in data pre-processing?
Data cleaning: Fill in or missing values, detect and remove noisy data and outliers.
Data transformation: Normalize data to reduce dimensions and noise.
Data reduction: Sample data records or attributes for easier data handling.
Data discretization: Convert continuous attributes to categorical attributes for ease of use with certain machine learning methods.
Text cleaning: remove embedded characters which may cause data misalignment, for e.g., embedded tabs in a tab-separated data file, embedded new lines which may break records, etc.
To deal with missing values, it is best to first identify the reason for the missing values to better handle the problem. Typical missing value handling methods are: Deletion: Remove records with missing values Dummy substitution: Replace missing values with a dummy value: e.g, unknown for categorical or 0 for numerical values. Mean substitution: If the missing data is numerical, replace the missing values with the mean. Frequent substitution: If the missing data is categorical, replace the missing values with the most frequent item Regression substitution: Use a regression method to replace missing values with regressed values.
Nearly all big tech companies have an artificial intelligence project, and they are willing to pay experts millions of dollars to help get it done. – By CADE METZ
Machine learning is a part of artificial intelligence. According to IBM’s forecast, job opening for artificial intelligence, machine learning and data science will increase 28% by 2020 (Forbes).
So if you are looking for a machine learning job or need to prepare for machine learning interview, then take a look at following questionaries.
What is machine learning?
Machine learning is a branch of Artificial Intelligence. It allows systems to automatically learn and improve from experience without being explicitly programmed.
What is artificial intelligence?
Artificial Intelligence is a branch of Computer Science that studies and researches to develop machines that have intelligence like human being. Most importantly, they can learn from experience and deal with new situations smartly.
What is the difference between artificial intelligence and machine learning?
Artificial Intelligence (AI) has many branches. One of them is ML. AI deals with broader context of developing a machine that can act like human and smartly. On the other hand, in machine learning we provide data to machines and they learn for themselves from that data.
What are the types of machine learning?
There are 3 types of machine learning. 1. Supervised learning, 2. Unsupervised learning and 3. Reinforced learning
What is Supervised machine learning?
In supervised machine learning, you provide a set of data with problems and answers. Machine learns from that set of data and applies learning in future.
What is Unsupervised machine learning?
In unsupervised learning, we don’t provide any solution data to machine. We provide them a set of data. The machine learns for itself.
What is Reinforcement machine learning?
Reinforcement learning is training by rewards and punishments. Here we train a computer as if we train a dog. If the dog obeys and acts according to our instructions we encourage it by giving biscuits or we punish it (by not providing biscuit or any other mean). Similarly, if the system works well then the teacher gives positive value (i.e. reward) or the teacher gives negative value (i.e. punishment). The learning system which gets the punishment has to improve itself. Thus it is a trial and error process.
Linear regression is a statistical method that attempts to model relationship between different scalar variables. There can be two or more variables. Among them, one is dependent variable. Others are independent variables.
What do you know about logistic regression?
Like all regression analyses, the logistic regression is a predictive analysis. Logistic regression is used to describe data and to explain the relationship between one dependent binary variable and one or more nominal, ordinal, interval or ratio-level independent variables.
What is the difference between linear regression and correlation?
From correlation we can only get an index describing the linear relationship between two variables; in regression can predict the relationship between more than two variables and can use it to identify which variables x can predict the outcome variable y. … While regression means going back towards average .
A logistic regression model is searching for a single linear decision boundary in your feature space, whereas a decision tree is essentially partitioning your feature space into half-spaces using axis-aligned linear decision boundaries. The net effect is that you have a non-linear decision boundary, possibly more than one.
This is nice when your data points aren’t easily separated by a single hyperplane. On the other hand, decision trees are so flexible that it depends on your specific problem and the data you have. Both decision trees (depending on the implementation, e.g. C4.5) and logistic regression should be able to handle continuous and categorical data just fine. It can be prone to overfitting. To combat this, you can try pruning. Logistic regression tends to be less susceptible (but not immune!) to overfitting.
Lastly, another thing to consider is that decision trees can automatically take into account interactions between variables. For example xyxy if you have two independent features xx and yy. With logistic regression, you’ll have to manually add those interaction terms yourself.
Which algorithms do we use for supervised machine learning?
K-nearest neighbors is a classification algorithm, which is a subset of supervised learning. K-means is a clustering algorithm, which is a subset of unsupervised learning. … In sum, they are two different algorithms with two very different end results
In statistics, a receiver operating characteristic curve, i.e. ROC curve, is a graphical plot. It illustrates the diagnostic ability of a binary classifier system as its discrimination threshold is varied. ROC analysis is related in a direct and natural way to cost/benefit analysis of diagnostic decision making.
In statistics, ordinary least squares (OLS) or linear least squares is a method for estimating the unknown parameters in a linear regression model. The goal of it is to minimizing the sum of the squares of the differences between the observed responses (values of the variable being predicted) in the given dataset and those predicted by a linear function of a set of explanatory variables.
Naive Bayes is a collection of classification algorithms based on Bayes Theorem. It is not a single algorithm but a family of algorithms that all share a common principle, that every feature being classified is independent of the value of any other feature. So for example, a fruit may be considered to be an apple if it is red, round, and about 3″ in diameter. A Naive Bayes classifier considers each of these “features” (red, round, 3” in diameter) to contribute independently to the probability that the fruit is an apple, regardless of any correlations between features. Features, however, aren’t always independent which is often seen as a shortcoming of the Naive Bayes algorithm and this is why it’s labeled “naive”.
“Support Vector Machine” (SVM) is a supervised machine learning algorithm which can be used for both classification or regression challenges. However, it is mostly used in classification problems. In this algorithm, we plot each data item as a point in n-dimensional space (where n is number of features you have) with the value of each feature being the value of a particular coordinate. Then, we perform classification by finding the hyper-plane that differentiate the two classes very well.
IBM Cognitive Hypervisor uses machine learning and cognitive computing to analyze medical data for real-time care
Summary: If you are not living in a cave or rural area, you must have heard the word “Machine Learning”. Although it is a term more related to “Computer Science”, people from other fields are also interested about it. So what is machine learning?
It is a branch of Artificial Intelligence (AI). It deals with huge amount of data. Different statistical algorithms and formula are applied to data to find pattern in the dataset or get a result. Simply speaking, it is a set of algorithms plus statistics.
Details: Machine learning is a buzz word of modern age. Literally it means, machines can learn from experience or data. In fact, machine learns more, if you provide more data.
Why machine learning is so popular?
Because if you can correctly choose right algorithm and statistical formula, then you can predict many things. For example, weather condition of future (Okay, near future), customer’s buying trend, share market movements etc.
What you need to learn to start machine learning?
Hardware: from single computer to cluster of inter-connected computers. Or, amazon’s EC2 instances.
Some machine learning algorithms
Some Statistics formulas
Framework (Tensorflow or deeplearning4j etc)
Any one programming language – python, java, scala.
