ASTR 408
STATISTICAL ANALYSIS IN PHYSICS AND ASTRONOMY

Spring Semester 2018 Room HBH 254; TTh 10:50am - 12:05pm

 

Instructor: Dr. Patrick Hartigan, Hermann Brown Rm. 350 , Phone: X2245

Office Hrs: After class and by appt.

Texts:

Grading: Based on short presentations (30%), homework creation, grading, and leading the discussion for the problems (25%), long presentations (25%), completing homework problems (10%), and preparation (10%). The preparation portion is based on whether or not the student has read the material beforehand and has otherwise prepared properly for class. The class format only functions well if everyone has their responsibilites completed on time. If a homework set is not created or a long presentation is not done the student will receive a 0 for that grade. The problem-creation+long-presentation grade is 50% of the total, and there are only one or two such events for each student during the semester, so it is important to have these ready on time. A student who otherwise gets straight A's on all other work who does not have a long presentation or homework-creation ready when it is scheduled will drop a full letter grade to a B.

Course Version: The course is also offered for graduate credit as {\it ASTR 508}. The course content is the same, but a larger fraction of the presentations are required of the graduate students.

Curriculum Fit: This class is one of the options for 4xx courses required for the B.S. Astrophysics degree. ASTR 408 is not currently within the data sciences rubric (major or minor). However, the DSCI curriculum is under development, so interested students should meet with faculty in charge of those degrees to determine whether or not ASTR 408 may substitute for a DSCI requirement.
Prereqs: There are no statistical prerequisites. We will cover material as we go.

OUTLINE OF COURSE
Every discipline of science has data, and a researcher generally wants to address a scientific question with the data. The path from the data to the conclusion usually involves some sort of statistical analysis. Even if the problem is not inherently a statistical one, when writing up the results one must always address the question of how certain the conclusions are given that there are uncertainties in the measurements. Often one looks for correlations between different variables, or tries to infer what the underlying structural variables are that define the system, and how they relate to one another. The statistical literature is vast and different disciplines tend to have their favorite techniques they apply to their data. But in most cases the techniques are perfectly valid over a wide range of applications.

In this class we will identify the statistical methods commonly used by research papers in physics and astrophysics. We will begin study of each method by having each student present a short summary of a paper they have found that uses the method. The subject area of the paper is completely up to the student. In the following class there will be a lecture on the mathematics of the method, and in the next class we will hear from students who have chosen this method for deeper study as they dive into their paper in depth. To solidify this knowledge, students will construct problems that will be distributed to the remainder of the class, and after a period of time we will discuss the solutions. A final lecture on the topic follows where we go over homework problems for the previous topic and discuss any outstanding questions about the material covered in the book and the methods we saw in the papers. Then we will move on to a new topic. By learning this way, we'll see how statistics is used in different areas. This experience broadens our toolset for use in our own studies.

The topics will be guided by the professor, but the papers are chosen by the students. Topic examples include hypothesis testing and confidence intervals, extracting periods and signals from time-series data, using principal component analysis, maximum likelihood methods, finding groups and clusters in multidimensional data, maximum entropy reconstructions, non-parametric ranks, optimized profile extractions, Bayesian analysis with priors and so on. Most statistical methods used in astronomy and physics will fall under one of the broad topics in this course, but if you have seen a technique and wondered how it works, we can substitute it for one of the other topics if there is interest. Find a paper that uses it and we will study it.

As described above, in class we will, (*) find a broad range of papers chosen by the students that use a particular method, (*) study the mathematics of the method, (*) go in-depth into two papers chosen by the students, and (*) work through some problems to understand how the method works in practice. The students will pick the papers, and will be expected to lead the class through an overview of the science objectives. The main focus, however, will be on the method, which we will then all study together to try to understand. The problem sets may apply the method to some other case, perhaps with contrived data, so we are all sure we could use it if the need arose in another context. There will be a few lectures at the beginning and then interspersed as needed throughout the semester to provide some mathematical structure, and we will follow the overall format of the textbook. While the textbook examples tend to come from astronomy, the student-chosen papers need not. In the past students have chosen papers from the fields of biology, geology, economics, linguistics, social sciences, oceanography, medicine, and political science. All of these are acceptable. In this class the application is less important than the method.

Analysis for this class is done in the R programming language. The book contains many examples of R code. R is a free package, and has convenient structure for loading and manipulating large data sets.

Tyipcal Work Load, Absence and Late Policies:

Outcomes/Assessments
(This section is now required by the Rice Administration for all Syllabi)

Students completing this class should be able to do the following: SPRING 2018 Schedule

DATE Topic Class Type Subject and Items Due
T Jan 9 Mathematical Foundation Lecture    Probability Concepts CHAPTER 2
Th Jan 11 " Lecture    Probability Distributions CHAPTER 4
T Jan 16 " Lecture    Confidence Intervals and Hypothesis Testing CHAPTER 3
Th Jan 18 Nonparametrics Paper Discussions    Short Presentations [Everyone]
   Math HMWK handout [pmh]
T Jan 23 " Lecture    CHAPTER 5
Th Jan 25 " Lecture/Long Paper    Long presentation [Laura]
T Jan 30 Regression Paper Discussions    Short Presentations [Everyone]
   Nonparametrics HMWK handout [Adolfo]
   Math HMWK due [Everyone]
Th Feb 1 " Lecture    CHAPTER 7
T Feb 6 " Lecture/Long Paper    Long presentation [Rae]
Th Feb 8 Spring Recess --- ---
T Feb 13 Data Smoothing Paper Discussions    Short Presentations [Everyone]
   Regression HMWK handout [Laura]
   Nonparametric HMWK due [Everyone but Adolfo]
Th Feb 15 " Lecture    CHAPTER 6
T Feb 20 " Lecture/Long Paper    Long presentation [Adolfo]
Th Feb 22 Multivariate Analysis/PCA Paper Discussions    Short Presentations [Everyone]
   Data Smoothing HMWK handout [Asa]
   Regression HMWK due [Everyone but Laura]
T Feb 27 " Lecture    CHAPTER 8
Th Mar 1 " Lecture/Long Paper    Long presentation [Laura]
T Mar 6 Time Series Analysis Paper Discussions    Short Presentations [Everyone]
   Multivariate/PCA HMWK handout [Adolfo]
   Data Smoothing HMWK due [Everyone but Asa]
Th Mar 8 " Lecture    CHAPTER 11
T Mar 13 Spring Break --- ---
Th Mar 15 Spring Break --- ---
T Mar 20 Time Series Analysis Lecture/Long Paper    Long presentation [Asa]
Th Mar 22 Clustering Paper Discussions    Short Presentations [Everyone]
   Time Series Analysis HMWK handout [Alison]
   Multivariate/PCA HMWK due [Everyone but Adolfo]
T Mar 27 " Lecture    CHAPTER 9
Th Mar 29 " Lecture/Long Paper    Long presentation [Alison]
T Apr 3 Truncated Data Paper Discussions    Short Presentations [Everyone]
   Clustering HMWK handout [Asa]
   Time Series HMWK due [Everyone but Alison]
Th Apr 5 " Lecture    CHAPTER 10
T Apr 10 " Lecture/Long Paper    Long presentation [Rae]
Th Apr 12 Spatial Point Processes Paper Discussions    Short Presentations [Everyone]
   Truncated Data HMWK handout [Rae]
   Clustering HMWK due [Everyone but Asa]
T Apr 17 " Lecture    CHAPTER 12
Th Apr 19 " Lecture/Long Paper    Long presentation [Alison]
   Truncated Data HMWK due [Everyone but Rae]
T May 1 Course Summary due [Everyone]

Honor Code: A general description of the honor code is avilable on-line. Students should turn in their own work and analysis on the homework sets, but may discuss the general nature of the problems with one-another.

Disability Accommodation: If you have a documented disability that will impact your work in this class, please contact me to discuss your needs. Additionally, you will need to register with the Disability Support Services Office in the Ley Student Center.


Short summary of techniques