Lecture 01 — Introduction to Computer Vision

Lecture 1

Dr. Muhammad Kazim

Department of Intelligent Systems, University of Lahore

Course Overview

Course Name Intelligent Vision Systems
Program BSES, 7th Semester, Section A
Semester Duration August 31 – December 14, 2026 (16 Lectures)
Class Meeting Times 11:00 AM–2:00 PM, Monday
Class Location E1 - 404 Lab

Instructor

Dr. Muhammad Kazim:

  • Assistant Professor, Department of Intelligent Systems
  • University of Lahore, Pakistan
  • Preferred form of address: Please call me Kazim.

Teaching:

  • “Intelligent Vision Systems” — BSES, 7th Semester, Section A

Email:

Course Learning Objectives

  • Explain fundamentals of image formation, representation, color, and processing.
  • Apply filtering, convolution, Fourier analysis, edge detection, and Hough methods.
  • Detect, describe, and match visual features.
  • Apply camera geometry, calibration, stereo vision, and motion estimation for 3D vision.
  • Implement classical recognition and detection methods, including SIFT and HOG.
  • Apply machine learning and deep learning to classification, detection, and segmentation.
  • Develop and evaluate computer vision pipelines using Python and OpenCV.

Computer Vision and Nearby Fields

Computer Vision

Real world
  ↓ images, videos, sensor data
Computer Vision
  ↓ information / understanding
Model of the visual world

Computer vision tries to infer useful information about the real world from images, videos, and other visual sensor data.

Computer Graphics

Model of the visual world
  ↓ rendering / simulation
Computer Graphics
  ↓ images, videos, interaction
Digital world

Computer graphics often works in the opposite direction: from models to images.

Real-world image

Rendered / digital world

Scope of Computer Vision

Computer vision uses ideas from many fields. In this course, in addition to theory, we focus on practical computer vision algorithms and tools.

Quick Discussion

Two faces, or a vase? What you see depends on how you look.

Think of at least one computer vision application you already know.

CV Applications

  • Smartphones & Consumer Devices: QR codes, computational photography, panorama stitching, face detection/recognition, face filters, depth sensing, pose estimation, visual search
  • Wearables: Heart-rate estimation, gesture recognition, activity monitoring, proximity sensing
  • Security & Biometrics: Fingerprint, iris, and face recognition; access control; CCTV monitoring; identity verification
  • Web & Social Media: Image search, photo organization, image captioning, content moderation, visual recommendations, geolocalization
  • AR/VR & Virtual Worlds: Head/hand tracking, SLAM, gesture recognition, virtual try-on, digital humans, mixed reality
  • Telepresence: Virtual backgrounds, face/person tracking, gaze correction, video enhancement
  • Media & Entertainment: Visual effects, motion capture, sports replay, video editing, automatic content analysis
  • Transportation: Autonomous driving, driver monitoring, lane/object detection, traffic analysis, navigation
  • Retail & Supermarkets: Cashier-less checkout, inventory monitoring, theft detection, product recognition, automated sorting
  • Medical Imaging: CT/MRI reconstruction, assisted diagnosis, pathology, endoscopy, surgical guidance
  • Robotics & Embodied AI: Perception, localization, mapping, navigation, manipulation, human-robot interaction
  • Manufacturing: Visual inspection, defect detection, quality control, process monitoring, automation
  • Agriculture & Environment: Crop monitoring, precision agriculture, wildlife monitoring, environmental inspection
  • Remote Sensing & Geospatial: Satellite/aerial imagery, mapping, change detection, disaster response
  • Space Exploration: Planetary rovers, telescope imagery, terrain analysis, autonomous exploration
  • Accessibility: Scene description, OCR, object recognition, visual assistance for users with impairments
  • Multimodal & Generative AI: Vision-language models, visual assistants, image/video generation, editing, and understanding

Computer Vision on Smartphones

QR codes

Panorama

Face and emotion detection

Smartphones: Face Filters

Security & Biometrics

Iris recognition:

Visual Search & Recognition

Google Lens: recognize objects, products, landmarks, plants, text, and other visual content

AR/VR & Spatial Computing

Virtual and mixed reality

3D Reconstruction

Recovering the 3D structure of a scene from multiple images taken from different viewpoints.

Visual Effects & Motion Capture

Dawn of the Planet of the Apes

Motion capture and computer vision algorithms transform actors into digital character.

Transportation: Autonomous Driving

Computer vision enables detection, tracking, localization, scene understanding, and navigation for automomous cars.

Medical Imaging

MRI / CT

Reconstruction, segmentation, detection, and diagnosis

Ultrasound

Imaging, measurement, diagnosis, and surgical guidance

Astronomy & Remote Sensing

Cloudy

Clear

Example application: Cloud detection in astronomical imaging

Image by Charlie Hagen (Mines alumnus): https://www.nightphotons.com/

Space Exploration: Visual Navigation

Mars 2020 mission used vision-based localizatoin during landing:

  1. Capture descent images
  2. Compare images with an orbital map
  3. Estimate location and adjust if necessary

Robotics & Embodied AI

Robots use vision for perception, localization, mapping, navigation, manipulation, and interaction with the physical world.

Vision-Language & Generative AI

“Teddy bears working on new AI research underwater with 1990s technology”

“Cats playing chess”

“A teddy bear sitting at the Colorado School of Mines”

Modern vision systems increasingly combine visual understanding, language, reasoning, and generation.

A Glimpse of What's Ahead

A preview of the kind of project you will build during this course.

Real-World Deployed Systems

A closer look at production computer-vision modules already deployed in the field.

Case Study: License Plate Recognition

Automated license plate recognition key features

Case Study: Face Recognition

Face recognition key features

Case Study: Workplace Safety (Hard Hat Detection)

Hard hat detection key features

Case Study: Object in Zone

Object in zone key features

Case Study: Traffic Analytics

Traffic analytics key features

Case Study: Public Gatherings & Crowd Control

Public gatherings and crowd detection key features

Case Study: Gates (ALPR Lite)

Gates / access-control key features

Case Study: Retail Analytics

Retail analytics use case

Case Study: Smart Mall

Smart mall analytics

Case Study: Queue Management

Queue management analytics

Case Study: Heat Map

Heat map analytics

Case Study: Loitering Detection

Loitering detection key features

Case Study: Gender / Age Determination

Gender and age determination key features

Case Study: Line Crossing & Intrusion Protection

Intrusion protection key features

Case Study: Lost Things

Lost things detection key features

Case Study: Fire Protection

Fire protection key features

Case Study: Lost Children

Lost children detection key features

Case Study: Smoking Detection

Smoking detection key features

What Is Computer Vision?

From a working definition, to why the problem is fundamentally hard.

A Definition, Starting with Aristotle

Bust of Aristotle beside the quote: To know what is where by looking.

“To know what is where by looking.” — Aristotle (c. 300 BC)

Computer Vision: A Working Definition

The study of recovering useful properties of the world from one or more images with an algorithmic level of specification.

The study of recovering useful properties of the world from one or more images, with an algorithmic level of specification.

The 1966 MIT “Summer Vision Project”

Scan of MIT Project MAC Vision Memo No. 100, The Summer Vision Project, Seymour Papert, July 1966.

Papert proposed to “construct a significant part of a visual system” over a single summer. Sixty years later, the problem is still open.

What Makes Computer Vision Hard?

Text reading: What makes computer vision HARD?

To a Computer, an Image Is Just Numbers

Black-and-white photograph of the Toronto skyline reflected in water.

We see a skyline. The computer receives only a grid of intensity values.

What the Computer Actually Sees

A close-up region of an image shown as a grid of pixel intensity values around 208-215.

A patch of “sky” is just numbers near 210 — no objects, edges, or meaning attached.

Many Scene Factors Collapse into One Pixel

Pixel-value grid overlaid with the terms scene geometry, scene surface microstructure, and scene illumination.

Each measured value mixes scene geometry, surface microstructure, and illumination — and we must undo that mixing.

Vision Is an Inverse Problem

Diagram: a 3D surface patch projecting down onto an image plane.

Image formation maps a 3D scene to a 2D image. Vision has to run that map backwards.

Infinitely Many Scenes Explain One Image

Diagram: several different 3D surfaces that all project to the same shape on the image plane, labelled infinite number of possible shapes.

An infinite number of 3D shapes produce the same projected image. The problem is ill-posed without prior assumptions.

Perception Can Be Fooled: Anamorphic Art

3D pavement street art of Lego minifigures arranged as a terracotta army, viewed from the correct angle.

“3D Lego Terracotta Army” by Leon Keer et al. — flat pavement painted to project as depth from one viewpoint.

Perspective Illusion

Forced Perspective

Forced-perspective photograph on the Uyuni salt flat: a person appears to hold tiny people on an outstretched hand.

No depth cues on the salt flat, so the eye — and a camera — accept the wrong scene.

Illusions in the Wild

Perception Is Not Reality

Text: Perception is not reality, but a generated abstraction.

What we “see” is a model the visual system constructs — useful, but not a direct readout of the world.

Objects Vary Enormously in Appearance

Text: Objects can highly vary in appearance.

Varying Scales

An adult sumo wrestler facing a small child in a sumo stance.

The same category spans a huge range of sizes in the image.

Varying Instances

A row of many different puppy breeds.

“Dog” covers wildly different shapes, colours, and textures.

Occlusion

A cat mostly hidden behind a table edge, only its ears and eyes visible.

Most of the object is missing from the image, yet we still recognise it.

Highly Articulated Objects

A contortionist balanced on one hand in an extreme pose.

Bodies and other jointed objects deform into a vast space of configurations.

Course Structure

The course covers both classical and modern computer vision.

  • Classical CV: image formation, filtering, Fourier analysis, features, geometry, stereo, motion, and 3D vision
  • Modern CV: machine learning, image classification, object detection, segmentation, and deep learning
  • This is not a machine learning course, but we will introduce the ML/DL concepts needed for computer vision. Good follwo-up courses:
    • Deep Learning (Prof. Zibo Wang)
    • Computer Applied Computer Vision for Engineering Systems (Prof. Minghan Li)

400 vs. 500 level: There is no difference in course content. If appropriate, ask to count as 500.

Course Resources

Course Website: https://kazimbalti.github.io/intelligent-vision-systems/

  • Primary place to access the syllabus, course schedule, TA information, lectures, and other course information
  • Use this as your main entry point for the course

GitHub Repository: https://github.com/Kazimbalti/intelligent-vision-systems

  • Contains course source files, code, notebooks, and downloadable materials
  • Useful when you need to clone/download code or inspect the underlying files

Lectures:

  • Are grouped by topic and may be convered over multiple class sessions

Attendance Matters

  • In-person attendance is mandatory, although will not be monitored.
  • Some material will be discussed/developed only during class.
  • Material added/discussed during class will not be recorded or posted later.
  • You are responsible for material covered during any class you miss.
  • Students with less than 70% attendance will not be permitted to sit the final exam.

Bottom line: Being physically present and engaged in class is an important part of this course.

Assignments & Quizzes

  • Assignments and quizzes together make up 10% of the course grade (10 of 100 marks).
  • There are four graded assignments across the semester, plus periodic in-class quizzes.
  • Assignments must be prepared and submitted individually.
  • You may discuss problems and help each other, but you must understand and create your own solution.
  • Identical submissions are considered plagiarism and receive a grade of zero.
  • Quizzes test the previous week’s theory at the start of selected sessions; best scores counted.
Assignment Topic Out Due
1 Image processing Wk 3 Wk 4
2 Filtering & features Wk 6 Wk 7
3 Motion & tracking Wk 11 Wk 12
4 Deep detection Wk 13 Wk 14

Late Assignments

  • Assignment due dates and times are posted on the Schedule and Assignments pages of the course website.
  • Each student has a budget of 4 late days for the term, used in whole-day units, at most 2 per assignment.
  • After the budget is spent, the maximum score drops 15% per day, for up to 3 days, then reaches zero.
  • Exams and the capstone demo/presentation cannot use late days.

Plan ahead and submit assignments on time.

Exams

  • Exams account for 60% of the course grade — Midterm (20) + Final (40), of 100 marks.
  • There are two exams: one Midterm and one Final.
  • Midterm Exam (20 marks) — Week 8; covers weeks 1–8 (image formation through descriptors, matching & RANSAC).
  • Final Exam (40 marks) — finals week; cumulative, weighted toward recognition, deep learning & embedded deployment (weeks 10–16).
  • Exams are in person, based on lecture slides, material discussed in class, and lab/assignment work.
  • No resources are allowed during exams, including notes, internet searches, GenAI, calculators, or smartphones.

Together, the Midterm and Final make up 60% of your course grade — plan your revision accordingly.

Grading

Regular course grade:

  • Final Exam: 40 Marks
  • Midterm Exam: 20 Marks
  • Lab Project: 30 Marks
  • Quizzes/Assignments: 10 Marks
  • Total: 100 Marks

Optional bonus assignments/projects may be offered at the instructor’s discretion.

\[ \text{Amended Final Grade} = \text{Final Grade} + \text{Bonus Points} \]

  • Maximum bonus: 5 points
  • Amended grades above 100 are capped at 100.
  • Letter grades are based on the amended final grade; see the syllabus.

Generative AI: Use It Carefully

Generative AI can be useful, but do not use it to solve your homework for you.

  • Good use: help remembering syntax, understanding an error message, or explaining a programming concept
  • Bad use: asking GenAI to solve the problem and copy-pasting the generated code into your submission
  • If AI writes your code, you will complete the assignment without actually learning how to program.
  • You are responsible for understanding every line of code you submit.
  • During exams, GenAI use is prohibited.

You need to be able to code without AI.

  • Many robotics, research, industrial, secure, and field environments have limited or no internet access.
  • Companies hire you to solve problems that GenAI cannot solve.
  • Use GenAI as a learning aid, not as a replacement for learning.

Academic Integrity

Academic dishonesty will be taken very seriously.

Examples include:

  • Copying another student’s homework
  • Using prohibited resources during an exam
  • Misrepresenting or abusing an excused absence

You may collaborate and discuss homework, but the work you submit must be your own.

Getting Help

Please use the following process when you need help:

  1. Try the problem yourself first (search course resources or online for 30 minutes).
  2. Ask classmates or post the question on the class discussion forum.
  3. Ask the TAs, preferably through the discussion forum when the question may help others.
  4. Ask the instructor or come to office hours.

When asking for help:

  • Explain what you are trying to do.
  • Show what you have already tried.
  • Include relevant error messages/code when appropriate.

Ask early. Waiting until the deadline makes it much harder for us to help you.

Computers & Programming

  • You are expected to have access to a computer for programming and in-class activities.
  • Classroom computers are available if needed.
  • Loaner laptops may also be available through the library.
  • The only programming language used for this course is Python (OpenCV and PyTorch libraries).
  • We will not use other languages (C++, MATLAB, etc.) because this will complicate TA help and grading.

Expected Workload

Expect this course to require approximately 10 hours per week on average, including:

  • Attending class
  • Reviewing lecture material
  • Programming
  • Completing homework
  • Preparing for exams

Some students will need substantially more time, particularly if they are less comfortable with:

  • Python/programming
  • Calculus
  • Linear algebra (matrix computations)

Do not fall behind early.

Key Things to Remember

  • Attend class — less than 70% attendance means you cannot sit the final exam.
  • Complete every assignment — assignments and quizzes make up 10% of your grade.
  • Late assignments: 4 late days per term, then 15% per day for up to 3 days, then zero.
  • The Midterm (20%) and Final (40%) together make up 60% of your grade.
  • The capstone Lab Project is 30% of your grade — start planning early.
  • Use GenAI to learn, not to avoid learning how to code.
  • Ask questions early — in class, office hours, or the class discussion channel.
  • Check the course website regularly for the schedule, lectures, and updates.
  • Academic dishonesty is taken very seriously.
  • Be professional, be kind.

Most importantly: keep up with the course and ask for help before small problems become large ones.

Thank You

Questions & Discussion

Dr. Muhammad Kazim · Department of Intelligent Systems, University of Lahore
muhammad.kazim@is.uol.edu.pk