Cheat sheet: AI, ML, Python, data, and model evaluation reference for Python Institute PCEI-30-01 candidates.
Use the tables for a quick pre-exam check. Expand a topic’s notes for explanations, examples, and additional distinctions.
Scope and study context
Item
Reference
Vendor/provider
Python Institute
Official exam title
Python Institute PCEI - Certified Entry-Level AI Specialist with Python (PCEI-30-01)
Exam code
PCEI-30-01
Page purpose
Independent quick review for AI concepts, Python patterns, data workflows, model selection, and evaluation basics
Best use
Review terms, choose algorithms from scenarios, read short Python snippets, and identify common AI/ML mistakes
Focus on practical distinctions: classification vs regression, training vs inference, parameter vs hyperparameter, feature vs label, accuracy vs precision/recall, and model performance vs responsible AI risk.
For the PCEI-30-01 exam, use original practice questions to test recognition and reasoning, not memorization alone.
A strong practice sequence is:
Start with short topic drills on AI terminology, Python basics, data handling, and evaluation metrics.
Review detailed explanations for every missed or guessed question.
Create a mistake log grouped by topic: Python, data, workflow, models, metrics, ethics.
Re-drill weak areas until you can explain why each wrong option is wrong.
Move to mixed question bank sessions to practice switching topics.
Finish with mock exams under timed conditions.
Use the final review to target only the areas still causing errors.
Practice is most useful when explanations force you to compare close choices: classification vs regression, precision vs recall, validation vs test, overfitting vs underfitting, and AI vs ML vs deep learning.
AI and machine learning concept map
Term
Compact meaning
Exam-use distinction
Artificial intelligence, AI
Systems that perform tasks associated with human intelligence
Broad umbrella: may include rules, search, ML, robotics, NLP, vision
Machine learning, ML
Models learn patterns from data instead of being explicitly programmed for every rule
ML is a subset of AI
Deep learning, DL
ML using multi-layer neural networks
Strong for images, speech, text, and large unstructured data
Data science
Extracting insights from data using statistics, programming, and domain knowledge
May include analytics without predictive AI
Model
Learned or designed function that maps inputs to outputs
Trained model is used for inference
Training
Process of fitting model parameters using data
Uses training data and a loss/objective
Inference
Using a trained model to make predictions
Should not update learned parameters unless online learning is intended
Feature
Input variable used by the model
Example: age, pixel values, token counts
Label / target
Output the model should learn to predict
Present in supervised learning
Parameter
Learned internal value
Weights in linear models or neural networks
Hyperparameter
Chosen before or during training control
Learning rate, tree depth, number of clusters
Loss function
Quantity minimized during training
Cross-entropy for classification; MSE often for regression
Generalization
Performance on unseen data
Better exam answer than “memorizes training set”
Overfitting
Model fits training data too closely and performs poorly on new data
Often high train score, low validation/test score
Underfitting
Model is too simple or poorly trained to capture patterns
Low train and validation performance
Bias
In ML error: simplifying assumptions; in responsible AI: unfair systematic harm
Read the scenario carefully; the word has two contexts
Variance
Sensitivity to training data changes
High variance often means overfitting
Notes and examples
Machine learning workflow
A typical ML workflow is iterative. The first model is rarely the final model.
flowchart TD
A[Define problem] --> B[Collect data]
B --> C[Explore and clean data]
C --> D[Split data]
D --> E[Preprocess features]
E --> F[Train model]
F --> G[Evaluate model]
G --> H{Good enough?}
H -- No --> C
H -- Yes --> I[Deploy or use model]
I --> J[Monitor performance]
J --> C
Workflow decision points
Step
Key question
Trap to avoid
Define problem
What exactly should be predicted or automated?
Building a model before defining success
Collect data
Is the data relevant and representative?
Using convenient but biased data
Explore data
What patterns, gaps, and anomalies exist?
Skipping visualization and summary statistics
Split data
How will generalization be measured?
Testing on data used in training
Preprocess
What transformations are needed?
Fitting preprocessing on all data before splitting
Train
Which model is appropriate?
Choosing complexity without a reason
Evaluate
Which metric matches the goal?
Using accuracy for imbalanced problems
Monitor
Does performance remain stable?
Assuming deployment ends the project
Learning paradigms and task selection
Paradigm
Data available
Output
Common examples
Choose when
Common trap
Supervised classification
Features plus class labels
Category/class
Spam/not spam, disease/no disease, image class
Target is discrete
Predicting a number does not automatically mean regression if the number is a class code
Supervised regression
Features plus numeric target
Continuous value
Price, temperature, demand
Target is numeric and ordered/continuous
Do not use accuracy for regression
Unsupervised clustering
Features without labels
Groups/segments
Customer segments, document groups
Need structure discovery
Clusters are not automatically “correct labels”
Unsupervised dimensionality reduction
Features without labels
Fewer transformed features
PCA, visualization, compression
Need simplify high-dimensional data
Transformed components may be hard to interpret
Reinforcement learning
Agent, environment, rewards
Policy/actions
Game agent, robotics control
Sequential decisions with feedback
Reward design is critical; not the default for normal labeled datasets
Semi-supervised learning
Few labels plus many unlabeled samples
Improved supervised model
Label-scarce image/text tasks
Labels are expensive
Unlabeled data must be relevant to the same problem
Self-supervised learning
Labels generated from data itself
Representations/pretraining
Masked words, contrastive learning
Large unlabeled text/image data
Not the same as manually labeled supervised learning
End-to-end AI/ML workflow
flowchart LR
A[Define problem] --> B[Collect data]
B --> C[Explore and clean]
C --> D[Split data]
D --> E[Preprocess and engineer features]
E --> F[Train model]
F --> G[Validate and tune]
G --> H[Test once]
H --> I[Deploy or report]
I --> J[Monitor drift, errors, bias]
High-yield distinction: model accuracy is not the same as model acceptability. A model can score well and still be unsafe, unfair, nontransparent, or inappropriate for deployment.
Responsible AI and ethics
For the Python Institute PCEI - Certified Entry-Level AI Specialist with Python (PCEI-30-01) exam, responsible AI concepts are important because entry-level AI specialists must understand that technical work has human impact.
Topic
Practical meaning
Fairness
Avoid unjust performance differences across groups
Bias
Data, labels, or design choices can disadvantage groups
Transparency
Users and stakeholders should understand system behavior at an appropriate level
Explainability
Ability to describe why a model made a prediction
Privacy
Protect personal or sensitive data
Security
Prevent misuse, tampering, or data exposure
Accountability
Humans remain responsible for system design and use
Safety
Reduce harmful outputs or decisions
Human oversight
Critical systems should not rely blindly on automation
Responsible AI decision rules
Do not deploy a model just because it has a good metric.
Check who benefits and who may be harmed.
Consider whether the data was collected with appropriate consent and safeguards.
Evaluate performance across meaningful subgroups when relevant.
Use human review for high-impact decisions.
Document assumptions, limitations, and intended use.
Monitor for drift, misuse, and unexpected failures.
“Reduce many features while preserving information”
Dimensionality reduction
“Agent learns by reward and penalty”
Reinforcement learning
“Images with spatial patterns”
CNN or image-focused preprocessing
“Text meaning or semantic search”
Embeddings, language models, NLP
“Rare positive class”
Precision, recall, F1, PR AUC; not accuracy alone
“False negative is dangerous”
Prioritize recall/sensitivity
“False positive is expensive”
Prioritize precision
“Very high training score, weak validation score”
Overfitting
“Preprocessing used before split”
Data leakage risk
“New data no longer matches training data”
Drift / distribution shift
“Need human-understandable rules”
Simpler interpretable model or explanation method
Common traps to eliminate
Logistic regression is for classification, not ordinary numeric regression.
Accuracy can be a poor metric when classes are imbalanced.
Test data is not for tuning. Use validation or cross-validation for model selection.
Fit preprocessing only on training data; transform validation/test using training-fitted steps.
Correlation does not prove causation.
Hyperparameters are chosen, while parameters are learned.
Scaling matters for distance-based and gradient-based methods; it is usually less critical for tree-based models.
Unsupervised learning has no labels during training.
A larger model is not automatically better; it can overfit and be harder to explain.
A seed improves reproducibility, not necessarily model quality.
Good average performance can hide subgroup failure.
Generative AI output must be verified when correctness matters.
Last-pass checklist for PCEI-30-01 review
Use this checklist before practice questions for the Python Institute PCEI - Certified Entry-Level AI Specialist with Python (PCEI-30-01):
Identify the ML task from the target: category, number, cluster, sequence action, or generated content.
Name the correct data split and what each split is allowed to influence.
Match metric to business error: false positive, false negative, continuous error, ranking, or imbalance.
Recognize leakage in preprocessing, feature creation, duplicates, and time-based data.
Distinguish AI, ML, deep learning, NLP, computer vision, and generative AI.
Read Python code for mutability, slicing, function return values, array shape, and fit/predict flow.
Know when scaling, encoding, imputation, tokenization, and embeddings are needed.
Recognize overfitting and underfitting from train/validation patterns.
Include responsible AI risks when a scenario mentions privacy, fairness, safety, transparency, or misuse.
High-yield exam mindset
The PCEI-30-01 exam is entry-level, so expect emphasis on whether you understand the role of AI and Python in practical workflows, not whether you can derive advanced research-level models from scratch.
Proportion of variance explained, in a simplified interpretation
Can be misleading if used alone
Bias, variance, and generalization
Key ideas
Concept
Meaning
Symptom
Underfitting
Model is too simple or poorly trained
Poor training and test performance
Overfitting
Model memorizes training data instead of generalizing
Strong training performance, weak test performance
Bias
Error from overly simple assumptions
Misses important patterns
Variance
Error from being too sensitive to training data
Performance changes greatly across samples
Generalization
Performance on new, unseen data
Measured with validation/test data
Notes and examples
Ways to reduce overfitting
Use more representative training data.
Use a simpler model.
Regularize the model.
Prune a decision tree.
Use cross-validation where appropriate.
Stop training earlier for iterative models.
Remove noisy or leakage-prone features.
Evaluate on data not used for fitting or tuning.
Ways to reduce underfitting
Use more relevant features.
Use a more expressive model.
Train longer if the model is not converged.
Reduce excessive regularization.
Improve preprocessing.
Reconsider whether the chosen model family fits the problem.
Data splitting and leakage
Split types
Split
Purpose
Training set
Fit model parameters
Validation set
Tune model choices and compare candidates
Test set
Estimate final generalization after decisions are made
Cross-validation
Repeatedly train/evaluate across folds to get more stable estimates
Data leakage examples
Leakage pattern
Why it is wrong
Scaling using all data before splitting
Test-set information influences training transformation
Including a future value as a feature
Model uses information unavailable at prediction time
Duplicate records in train and test
Model may effectively see test examples during training
Target-derived feature
Feature directly or indirectly reveals the answer
Tuning repeatedly on the test set
Test set becomes part of model selection
A reliable rule: anything learned from data during preprocessing should be learned only from the training data, then applied to validation/test data.
Natural language processing basics
Concept
Meaning
Tokenization
Splitting text into words, subwords, or tokens
Stop words
Common words sometimes removed, depending on task
Stemming/lemmatization
Reducing words to base-like forms
Bag of words
Represents text by word counts, often ignoring order
TF-IDF
Weights words by frequency and distinctiveness
Embedding
Numeric vector representation of text meaning or usage patterns
Sentiment analysis
Predicting positive, negative, or neutral sentiment
Language model
Model trained to predict or generate language-like sequences
Common NLP traps:
Text must be converted to numeric features before most ML models can use it.
Removing stop words is not always helpful; it depends on the task.
Bag-of-words models often ignore word order.
Generated text can be plausible but false.
Training text may contain social, cultural, or factual bias.
Computer vision basics
Concept
Meaning
Pixel
Smallest image element
Channel
Color or intensity component, such as red, green, blue
Resolution
Image width and height
Convolution
Operation that detects local patterns using filters
Pooling
Reduces spatial size while retaining important information
Data augmentation
Creates transformed versions of images to improve robustness
Classification
Assigns an image-level label
Detection
Locates and classifies objects
Segmentation
Labels image regions or pixels
Common computer vision traps:
Image size and channel order matter.
Normalization can affect model performance.
Training on clean images may not generalize to real-world images.
Augmentation should reflect realistic variation.
A high-performing model can still fail on underrepresented conditions.
Generative AI review
Concept
Meaning
Prompt
Input instruction or context given to a generative model
Completion/output
Generated response
Hallucination
Plausible-sounding but incorrect or unsupported output
Temperature
Setting that can influence randomness in generation
Context window
Amount of input/output context the model can consider
Fine-tuning
Further training a model for a specific task or style
Retrieval-augmented generation
Supplying external retrieved information to support generation
Guardrails
Controls to reduce harmful, unsafe, or off-task outputs
Common traps:
Generative output should be verified, especially for facts, code, legal, medical, or financial content.
A confident tone is not evidence of correctness.
Sensitive data should not be casually entered into AI tools.
Prompting can guide output, but it does not guarantee truth.
Evaluation of generative AI may require human judgment as well as automated metrics.
Statistics and probability essentials
Concepts to recognize
Concept
Meaning
Mean
Average value
Median
Middle value when sorted
Mode
Most frequent value
Range
Difference between maximum and minimum
Variance
Average squared spread from the mean
Standard deviation
Typical spread from the mean
Distribution
Pattern of values
Outlier
Unusually extreme value
Correlation
Degree to which variables move together
Probability
Likelihood of an event
Random variable
Quantity with uncertain outcome
Correlation warning
Correlation is useful for exploring relationships, but it does not prove causation. A model may exploit correlations that are unstable, biased, or not meaningful in the real world.
Fast decision tables
Which task is this?
Scenario
Likely task
Predict tomorrow’s temperature
Regression
Predict whether an email is spam
Binary classification
Sort news articles into topics without labels
Clustering
Reduce 500 features to 2 for visualization
Dimensionality reduction
Detect unusual credit-card transactions
Anomaly detection
Generate a summary of a document
Generative AI or NLP
Identify cats in images
Computer vision classification or detection
Notes and examples
Which metric is most appropriate?
Scenario
Better metric focus
Fraud detection with rare fraud cases
Recall, precision, F1, PR-AUC
Medical screening where missing cases is costly
Recall
Search results where returned positives must be relevant
Precision
Balanced image classification
Accuracy plus per-class metrics
Predicting sale price
MAE, RMSE, R-squared
Comparing models during tuning
Validation performance, not test performance
Which preprocessing step?
Problem
Likely response
Missing numeric values
Impute, remove if justified, or investigate source
Text categories
Encode categories
Very different numeric scales
Scale or normalize for distance/gradient-sensitive models
Duplicated observations
Remove or investigate
High-cardinality categories
Use careful encoding strategy
Text data
Tokenize/vectorize
Image data
Resize/normalize
Time-ordered data
Preserve chronology when splitting
Common candidate mistakes
Concept mistakes
Saying AI, ML, and deep learning are identical.
Calling every automated system “machine learning.”
Forgetting that labels are required for supervised learning.
Confusing validation data with test data.
Treating accuracy as universally best.
Assuming unsupervised clusters are automatically meaningful.
Ignoring class imbalance.
Assuming generated AI content is reliable without verification.
Notes and examples
Python mistakes
Misreading Python indexing and slicing.
Forgetting that many operations return new objects rather than modifying in place, or the reverse.
Confusing a list of lists with a two-dimensional numeric array.
Ignoring data types in columns.
Treating missing values as ordinary strings.
Reusing the same variable for different meanings.
Not separating features from the target.
Applying transformations inconsistently between training and test data.
Workflow mistakes
Building a model before defining the problem.
Training and testing on the same data.
Tuning based on test results repeatedly.
Failing to document preprocessing.
Ignoring deployment conditions.
Not monitoring for data drift.
Choosing the most complex model first.
Forgetting ethical and privacy considerations.
Mini review scenarios
Scenario 1: High accuracy but poor minority detection
A model predicts “not fraud” for nearly every transaction and reports high accuracy because fraud is rare.
What to think:
This is likely class imbalance.
Accuracy is misleading.
Review precision, recall, F1, and minority-class performance.
Consider resampling, class weights, threshold tuning, or better features.
Notes and examples
Scenario 2: Excellent training score, weak test score
A decision tree performs almost perfectly on training data but poorly on unseen data.
This suggests overfitting.
Try pruning, limiting depth, using more data, or using cross-validation.
Compare with simpler baselines.
Scenario 3: Test data used during preprocessing
A dataset is scaled before splitting into train and test sets.
This may leak information.
Split first.
Fit preprocessing on training data only.
Apply the learned transformation to validation/test data.
Scenario 4: Text model produces fluent false answer
A generative AI system writes a confident but incorrect explanation.
This is a hallucination or unsupported generation.
Verify against trusted sources.
Use retrieval, constraints, review, and guardrails where appropriate.
Final-day review checklist
Before you move into practice questions, make sure you can answer these quickly:
What is the difference between AI, ML, and deep learning?
What makes a problem supervised, unsupervised, or reinforcement-based?
How do classification and regression differ?
What are features, labels, training data, validation data, and test data?
Why is data leakage dangerous?
When is accuracy misleading?
How do precision and recall differ?
What does overfitting look like?
Why do many models require numeric feature representations?
What does scaling do, and when can it matter?
What are common uses of NumPy and pandas in AI workflows?
What are tokenization, embeddings, and image channels?
Why is responsible AI part of technical AI practice?
Why must generative AI outputs be checked?
How does Python support reproducible, structured AI work?