Language Processing
(Signals and Symbols)
CUNY Graduate Center – Spring 2025
- Instructor: Prof. Spencer Caplan
- Meetings: Mondays 11:45-1:45, (GC 7314)
- Office hours: Thursdays 3:15-4:15, GC 7400.02 and by appt
Overview
Language is perhaps the best window we have into cognition. Humans' knowledge of language consists not only in grammatical representation, but in the processes which operate over such representation. Thus, how we are able to convert gradient, continuous, ephemeral perceptual signals into discrete, mental symbols (and vice versa) is of fundamental importance to work toward a fuller understanding of the cognitive system of language.
This discussion-based seminar will provide a wide-ranging but in-depth overview of topics in the real-time processing of language, speech, and related perceptual domains. Special attention will be devoted to the use of simple algorithmic models and related experiments in order to explore the specific mechanisms involves in the mental representation and use of language.
Goals and Objectives
Materials
While there is no official textbook for the course, we will almost exclusively read primary papers from the relevant literature. All readings assigned throughout the term (both required and optional) will be posted to the course schedule/website.
With the goal of fostering focus, discussion, and the exchange of ideas, the use of screens (laptops, phones, etc.) will not be permitted during class. Any visual aids will be provided via physical materials (e.g. print outs) in class.
Grading
As a paper/discussion-centric seminar, the primary component of course grades (40%) will be calculated based on active participation and attendance throughout the term.
Students will also be required to submit a short document (less than a page) each week before class with notes/reflections from the assigned readings (this will constitute 30% of the overall grade).
Finally, students will write a term paper (consisting of a research project proposal)—the final paper will make up the remaining 30% of the grade. There will however, be no HWs, quizzes, or tests assigned throughout the term.
Accommodations
The instructor will attempt to provide all reasonable accommodations to students upon request. If you believe you are covered under the Americans With Disabilities Act, please direct accommodations requests to Vice President for Student Affairs Matthew G. Schoengood.
Attendance
The course takes place (in person) at the Graduate Center, and students are expected to attend all classes (in person). However, students who have reason to believe they may be contagious with an infectious disease should contact the instructor and stay home. Other absences will not be excused, and the instructor reserves the right to tie grades to attendance records.
Integrity
In line with the Student Handbook policies on plagiarism, students are expected to complete their own work. The general ethos of the integrity policy is that actions which shortcut the learning process are forbidden while actions which promote learning are encouraged. Studying and discussing notes, papers, and ideas together provides a fruitful avenue for learning and is encouraged. Using a classmate’s solution or text in your submitted notes or having someone else write a portion of your presentation, however, is prohibited because it circumvents the learning process. If you have any questions about what is or is not permissible, please contact your instructor.
The instructor reserves the right to refer violations to the Academic Integrity Officer.
Weekly Schedule
(Please note that this is subject to change.) That said, we'll plan to discuss at least some subset of: Marr's three-levels of analysis for information processing systems (Computational, Algorithmic, and Implementation), continuous vs. discrete representations in speech and vision, perception as a form of ``sampling,'' syntactic parsing/processing, categorical perception, pragmatic processing, the relationship between knowledge and perception (linguistic relativity), the time-course of spoken-word recognition, plasticity in both speech and syntactic processing, word learning, eye-movements in reading and perception; language production, ``frequency effects,'' and the influence of processing on the lexicon.
If you have a particularly strong interest in a topic not mentioned, just come talk to me and we may be able to add something in.
Week 0 (1/27) – Intro; Processing and Representation
(No readings to prep, but be sure to sign up for GitHub if you don't already have an account)
Week 1 (2/03) – Marr's Levels; Visual Representation of Images
Core:
Marr, D. 1982
Vision: A computational investigation into the human representation and processing of visual information. (Ch. 1-2)
MIT press.
Additional:
Quine, W.V.O. 2013
Word and object (Ch. 3)
MIT press.
Quine, W.V.O. 1957
The scope and language of science.
British Journal for the philosophy of Science, 8(29), 1-17.
Week 2 (2/10) – Speech Perception; Competition and Timecourse of Spoken Word Recognition
Core:
Liberman, A. M., Harris, K. S., Hoffman, H. S., & Griffith, B. C. 1957
The discrimination of speech sounds within and across phoneme boundaries.
Journal of experimental psychology. 54(5), 358.
"A Quick and Dirty summary of the Cohort Model"
Excerpt from Wikipedia
Allopenna, P. D., Magnuson, J. S., & Tanenhaus, M. K. 1998
Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models.
Journal of memory and language. 38(4), 419-439.
Additional:
Marslen-Wilson, W., & Tyler, L. K. 1980
The temporal structure of spoken language understanding
Cognition. 8(1), 1-71.
McClelland, J. L., & Elman, J. L. 1986
The TRACE model of speech perception.
Cognitive psychology. 18(1), 1-86.