Questions can be found at the very bottom.
is the set of natural numbers . Key properties of are that and . This natually leads to the idea of mathematical induction, which allows us to prove statements for all .
Mathematical induction works as follows: given a proposition , prove for the base case (or some other starting place) and then show that . This shows that is true for all (or subset if your base case is for instance).
Integers extend to include and negative numbers. Rationals are ratios of integers.
Property: If ( and are coprime) and satisfies with , , , then divides and divides .
A natural corollary to this can be found by taking the contrapositive, stating that if does not divide or does not divide , then cannot satisfy the equation. This allows us to enumerate all possible rational solutions to equations of that form.
Example: prove . solves . By the rational root theorem, the only possible rational roots are . Plugging these in, we can clearly see that none of them solve the equation. Thus the equation has no rational solution, and so cannot be rational.
Maximum of a set of is such that . Minimum is defined similarly. Maxima and minima need not exist. However, they must exist for finite, nonempty subsets of . Upper and lower bounds are defined similarly, but now need not exist in . These also need not exist, e.g. has no upper/lower bounds.
We define the least upper bound of S to be the and the greatest lower bound to be . Once again, these need not exist. However, we assume the Completeness Axiom to state that if is bounded from above, exists, and likewise for .
This allows us to prove the Archimedian Property, which states . A quick proof sketch: assume for sake of contradiction that but , . Bounded above, so use completeness axiom to show that exists but is not an upper bound.
A sequence is a function , typically denoted as . We define the limit of a sequence to be the number if , such that , we have .
An important theorem is that all convergent sequences are bounded (but not all bounded sequences are convergent!!). Proof sketch: fix an , which gives us an for which within of the limit. Then the function is either bounded by the bound or by the maximum of for , which is a finite set.
Limits of addition, multiplication, and division are equal to limits of addition, multiplication, and division of limits (assuming the individual limits exist and for division, taking care not to let the denominator equal 0).
Note that does not imply . Examples: , which but .
We define if such that .
For example, goes to because . Informally, because grows faster than , goes to infinity.
Monotone sequences: if a sequence is increasing (resp. decreasing) and bounded, then it is convergent. Proof sketch: consider the set of all . By completeness theorem, (resp. ) exists, so there is a sequence element greater than . Monotonicity implies that all elements after that satisfy the bound.
Given a sequence , define . Notably, . So decreasing and has a (possibly infinite) limit. We define
Example: . , .
Some properties of these: , since nonstrict inequalities are preserved under limits. Proof sketch: use the fact that subsets have smaller (or equal) compared to the superset.
Cauchy sequence: is a Cauchy sequence if , such that , we have .
Cauchy sequence converges. Proof sketch for reverse direction: consider N for bound . Then use triangular inequality.
Proof sketch for forward direction: first show (a_n) converges iff . Then show that exist and are equal, taking advantage of the fact that Cauchy implies bounded.
Recursive sequences: if , then if the limit exists and equals , then .
Example: If with , \implies which means . Be careful though, because the initial condition matters. Given out initial condition, we can bound between and inclusive for all relevant using induction, which implies is the correct answer.
Subsequences: If is a subsequence, let be a strictly increasing sequence in . Then we can define a new sequence , called a subsequence of .
An important property of subsequences is that even if a sequence does not converge to a value, a subsequence of that sequence may. Specifically, let be any sequence. has a subsequence converging to iff , the set is infinite. In other words, there are infinite elements within the epsilon bound of in .
Forward direction proof sketch: just use the definition of convergence. Reverse direction proof sketch: Consider taking smaller and smaller and taking an element from each shrinkage to create the convergent subsequence (make sure that each element has a greater index than the one before it).
Every sequence has a monotone subsequence. Proof sketch: Define a dominant term to be such that , . Either there are infinitely many dominant terms (then dominant terms form a monotone subsequence), or there are finitely many. In the second case, then after the last dominant term, each element has some element greater than it with a higher index. Use this to form a monotone subsequence.
This theorem allows us to prove that every bounded sequence has a convergent subsequence, because a monotone subsequence must exist and it will be bounded, implying that it is convergent.
Given a sequence (s_n), we say is a subsequence limit if there exists a subsequence that converges to . For example, and are subsequence limits. Proof sketch: Use definition of and , specifically that it is a limit of values of the tail. Use the limit to produce an bound on the of tails for large enough . Then show that this implies infinite elements of the original sequence in that bound.
Containing a single subsequence limit is necessary and sufficient for the existence of a convergent sequence.
Closed subsets: is closed if for all convergent sequences in , the limit also belongs to .
Example: is not closed, because the sequence converges to , which is not in the set.
An extremely important result is that for positive sequences, Proof sketch for last inequality (first is similar): Use fact that if , then . For , we have . Take of both sides, and the right side can be massaged to show .
A metric space is a set and a function $d: S \cross S \to \mathbb{R}^{0+}$. The function must satisfy nonnegativity, , commutativity, and the triangular inequality.
We can generalize sequences to use instead of . Specifically, if is a sequence in , then we define to be Cauchy if s.t. , . Also, we say converges to if , s.t. , . Just like the real number case, these two notions are equivalent.
We call a metric space complete if every Cauchy sequence has a limit in . For example, is not complete, but is.
The Bolzano-Weierstrass Theorem states that every bounded sequence in has a convergent subsequence.
A topology on a set is a collection of open subsets such that are open; (possibly infinite) union of open subsets are open, and finite intersection of open sets are open. We can define a topology on a metric space by defining the ball to be open.
We define to be closed iff is open, that is, , such that .
We define the closure of a set to be \bar{E} = \cap \{ F | F \subset S \text{ closed set, } F \subset E \}$. We similarly define the interior to be the union of all open subsets of . The boundary of is the set difference bewteen the closure and the interior.
We define the set of limit points to be all such points where , such that . Very importantly, . (It's also possible to *define* this way as Rudin does)
An important property relating closedness and sequences is that . The proof for both directions utilize proof by contradiction.
We define an open cover of to be a collection of open sets such that . From there, we can define compactness. A set is compact if for any open cover of , there exists a finite subcover.
For example, if is finite, we can produce a finite subcover by, for each , picking a such that . Then the subcover is finite.
The Heine-Borel Theorem states that a subset of is compact iff it is closed and bounded.
Lemma: a closed subset in a compact subset is compact.
Sequential compactness is an alternate definition of compactness, which states that is sequentially compact if every sequence of points in has a convergent subsequence converging to a point in .
Series is an infinite sum of a sequence: . We define convergence as the convergence of partial sums .
We say that a series satisfies the Cauchy Condition if such that , . A Cauchy series is equivalent to the sequence of partial sums being Cauchy which is equivalent to the convergence of both.
If the series converges, then . Note that the opposite is not necessarily true.
To determine whether series converge, we can use comparison tests.
Comparison test: Proof sketch: Show that is Cauchy. Related, we say that converges absolutely if converges.
A classic example of a series that does not converge absolutely is the alternating harmonic series.
For the following tests, we recall that
Root Test Let .
1. If , then series diverges
2. If , then series converges absolutely.
3. If , then series could converge or diverge.
Ratio Test Let .
1. If , the series converges absolutely.
2. If , the series diverges.
Alernating Series Test For “nonincreasing” (i.e. the absolute values of terms are nonincreasing) alternating series where the terms tend to 0, the series converges.
Example: converges since terms tend to 0 and is nonincreasing.
Integral Test If is continuous, positive, and decreasing such that , then convergence of the integral is same as convergence of series.
I already LaTaX'd notes on continuity which can be found here: https://rpurp.com/2021-03-02.pdf
Now let's examine the link between compactness and continuity. Specifically, if is a continuous map from to , then is compact if is compact. This can be proven by sequential compactness: a quick proof sketch is that for a sequence in , we can reverse the map to find a sequence in . Since is compact, there's a subsequence that converges to a value in . Since continuity preserves limits, this is a subsequence limit for the sequence in as well.
A corollary to this is that if is continuous and is compact, then $\existsp, q \in E$ such that and .
However, a preimage of a compact set may not be compact.
Uniform Continuity
is uniformly continuous if , such that . Compared with the normal definition of continuity, we notice that we must select a that works with *all* points. For regular continuity, we can choose a \delta per-point$.
Theorem: For , if is continuous and is compact, then is uniformly continuous.
Example: . Normally continuous except at . But if we restrict the domain to a compact interval , becomes uniformly continuous.
Interesting theorem: Given continuous with compact, and a bijection, then is continuous. Proof sketch: Show the preimage of an open set in is open.
Connectedness
We define connectedness as follows: is connected iff the only subset of that is both open and closed are and .
An alternate definition is that is not connected iff , $\U \cap V = \varnothing$ and . Or such that is both open and closed. Then .
Example: $X = [0,1] \union [2, 3]$. Then let and .
Theorem: Continuous functions preserve connectedness.
Theorem: .
Rudin definition for connectedness: cannot be written as , where .
Intermediate value theorem: This falls almost directly out of the fact that continuous functions preserve connectedness. If is continuous, and , then s.t. .
Discontinuities: Given the left and right-hand limits of at , if , we say the function is continuous at .
If both left and right-handed limits exist, but they disagree with each other or the value of the function, we call this a simple discontinuity. If one of the sides doesn't exist at all (classic example is around , then we call it a 2nd-type discontinuity.
Monotonicity and Continuous Functions: If is monotone-increasing, then has countably many discontinuities.
We say that a sequence of functions converges pointwise to if we have .
Example: . Then pointwise where .
An extremely useful object is the bump function, which we typically denote as
$\phi(x) = \begin{cases}0 & x<0
2x & x \in [0, 1/2]
1 -2x & x \in [1/2, 1]
0 & x > 1 \end{cases}$
For example, converges pointwise to 0.
We can see here that pointwise convergence does not preserve integrals. Also, convergence of doesn't imply convergence of (pointwise).
Vectors converging pointwise is equivalent to them converging in a sense. (Actually, as long as it is a norm).
We can also have uniform convergence of functions. We say that converges to uniformly if , such that , , we have .
We can also express uniform convergence using the equivalent notion of Uniformly Cauchy: s.t. , .o
We also can talk about series of functions . We say that this converges uniformly to if the partial sums converge uniformly to .
A test we can apply to see whether a series of functions converges uniformly is the Weierstrass M-test. If s.t. : if , then converges uniformly. A proof sketch: Consider the absolute value of the series and use the triangular inequality.
Unlike pointwise convergence, uniform convergence preserves continuity.
Theorem: If is compact, and with the following conditions:
1. is continuous
2. pointwise, continuous
3.
Then uniformly.
We define the derivative of as .
Differentiability implies continuity. This can be verified by multiplying the above by and using limit rules.
Chain rule: If , then .
We say f has a local maximum at if such that for all with .
If has a local maximum at , and if exists, then . This can be shown by bounding above and below by 0, proving it's 0.
Generalized MVT: If and are continuous on and differentiable on then such that
If we let , we get the regular MVT:
Intermediate Value Theorem for Derivatives: If is differentiable on and then such that .
Proof sketch: Let . goes from negative to postive, so somewhere attains its minimum and .
Correlary: If is differentiable on , cannot have simple discontinuities, only discontinuities of the second kind.
L'Hospital's Rule: Suppose and are real and differentiable on , and for all . Let if it exists.
If and as , or if as , then
The proof is quite involved and is included as a question later.
Taylor's Theorem
Let . Then there exists a point between and such that .
This is essentially a different way to generalize the mean value theorem.
This proof will also be included as a question.
Unless otherwise stated, assume is bounded and bounds of all integrals are from to .
We define a partition of as finite set of points such that and define for convenience.
We further define , , , and .
We define the upper and lower Riemann integrals of to be
and .
If the upper and lower integrals are equal, we say that is Riemann-integral on and write .
Since s.t. , we have for all , So and are bounded, so the upper and lower integrals are defined for every bounded function .
We now generalize a bit. Consider a partition and let be a monotonically increasing function on . We write .
We define and .
We define and .
If they are equal, we have a Riemann-Stieltjes integral
We define to be a refinement of if . The common refinement of and is defined to be $P_1 \union P_2$.
Theorem: and $U(P^*, f, \alpah) \le U(P,f, \alpha)$.
Proof sketch: To start, assume contains one more point than and consider the of the two “induced” intervals by 's inclusion. Clearly both are larger than (corresponding to original interval containing .
Theorem: . Proof sketch: . Fix and take over , then take over all .
Theorem 6.6: on iff such that .
If direction: $L \le \underline{ \int } \le \overline \int \le U$ so , so they are equal and .
Only if direction: If , s.t. and .
Take common refinement . Show .
Fun facts about 6.6:
1. If holds for some and some , then holds with same for refinement of .
2. If \in , then .
3. If f is integrable and hypotheses of hold, then
Theorem: Continuitiy implies integrability. Proof: use fact uniformly continuous.
Theorem: Monotonicity of and continuous implies integrability.
Theorem: If is continuous where is discontinuous, and has only finite number of discontinuities, then f is integrable.
Theorem: Suppose on , , continuous on , and on . Then on .
Properties of the integral (That you didn't learn in Calculus BC):
.
, integrable implies integrable. Proof sketch: let and use identity .
. Proof sketch: let .
Given unit step function , if then (This is quite similar to using the Dirac delta function in signal processing).
Relating sums and integrals: Given nonnegative , converges, and sequence , and continuous, If then .
Relating Derivatives and Integrals Assume is integrable. is integrable is integrable. In that case .
Proof sketch: Use Theorem 6.6. Then use mean value theorem to obtain points such that .
Change of Variable Theorem If is strictly increasing continuous function that maps onto , and is monotonically increasing on and on . Define and . Then .
Integration and Differentiation.
If , then continuous on , and if is continuous at , is differentiable at , and .
Proof sketch: Suppose . For : . So we can bound by epsilon since we can make as small as we want, therefore uniformly continuous.
If is continuous at , then given choose such that if and . Hence . Therefore, .
Fundamental Theorem of Calculus: If integrable and such that then .
1: Prove there is no rational number whose square is 12 (Rubin 1.2).
A: Such a number would satify . B the rational roots theorem, we can enumerate possible rational solutions . It can be verified that none of these satisfy the equation, so the equation has no rational solution, so no rational number has the square of 12.
2. Why is open in ?
A: For all points in S we can construct a ball such that the ball is entirely contained within the set S. This is because .
3. Construct a bounded set of real numbers with exactly 3 limit points.
A: {2, 1+ 1/2, 1 + 1/3, 1+1/4, \dots} \cup with limit points 0, 1, 2
4. Why is the interior open?
A: It is defined to the the union of all open subsets in $\E$, and union of open subsets are open.
5. Does convergence of imply that converges?
A: No. Consider . converges to but does not converge.
6. Rudin 4.1: Suppose is a real function which satisfies for all . Is necessarily continuous?
A: No: a function with a simple discontinuity still passes the test. In fact, since limits imply approaching from both sides, and when approaching zero are the same thing, anyway.
7. What's an example of a continuous function with a discontinuous derivative?
A: Consider . The corner at has different left and right-hand derivatives of and , respectively. This implies the derivative does not exist at , and a type-1 discontinuity exists there.
8. What's an example of a derivative with a type-2 discontinuity?
A: An example would be with The derivative not zero is which has a type-2 discontinuity at . (Source: https://math.stackexchange.com/questions/292275/discontinuous-derivative)
9: 3.3: Let be s.t. . Show as .
A: Assume WOLOG is positive (this extends naturally to the negative case with a bit of finagling) the limit exists since the sequence is decreasing and bounded below. Using recursive sequence we get which implies .
10: Can differentiable functions converge uniformly to a non-differentiable function?
A: Yes! Consider It is clearly differentiable, and converges to uniformly. It develops a “kink” that makes it non-differentiable.
11: 3.5: Let be a nonempty subset of which is bounded above. If , show there exists a sequence which converges to .
Consider expanding bounds. By definition, must contain a point in , otherwise is a better upper bound than the supremum! Thus we can make a sequence of points by starting with an epsilon bound of say, and sampling a point within it, and then shrinking the epsilon bound to , , , etc.
12: Show that if is rational and if is irrational has no limit anywhere.
A: Use the fact that is dense on . Given an , no matter what you pick you're always going to get both rational and irrational numbers within that epsilon bound, which means the function will take on both and within that bound, which exceeds the bound.
13: What exactly does it mean for a function to be convex?
A: A function is convex if , we have .
14. 5.2: Show that the value of in the definition of continuity is not unique.
A: Given some satisfactory , we can just choose . The set of numbers in the input space implied by is a subset of those from the old , so clearly all of the points must satisfy required for continuity.
15: Why is the wrong statement as presented in lecture for the Fundamental Theorem of Calculus Flawed?
A: The reason is that the derivative of a function is not necessarily Riemann integral.
16: What function is Stieltjes integrable but not Riemann integrable?
A: Imagine a piecewise function that is the rational indicator function for and 0 elsewhere. This is obviously not Riemann integrable but we can assign to be constant from to (i.e. assigning no weight to that part) to make it Stieltjes integrable. https://math.stackexchange.com/questions/385785/function-that-is-riemann-stieltjes-integrable-but-not-riemann-integrable
17: Why do continuous functions on a compact metrix space achieve their and ?
A: is compact, which implies that it contains its and .
18. What's a counterexample to the converse of the Intermediate Value Theorem?
A: Imagine piecewise function for and for .
19: Sanity check: why is continuous at ?
A: (Definition 3). Proving with Definition 1 is annoying but you can see the proof in the problem book.
20: Prove the corellary to the 2nd definition of continuity: is continuous iff is closed in for every closed set in .
A: A set is closed iff its complement is open. We can then use the fact that $f^{-1}(E^c} = [f^-1(E)]^c$ for every . (Basically, imagine the 2nd definition but you just took the complement of everything).
21: What's a function that is not uniformly continuous but is continuous?
A: A simple example is which is clearly continuous but finding a single value for for a given is impossible.
22: If we restrict to the domain , why does it become uniformly continuous?
A: This is because we restricted the domain to a compact set!
23: Give an example where is a subset of .
A: Consider the classic set $\{0\} \union \{1, 1/2, 1/3, 1/4, \dots}$. .
24: Give an example where it's a superset of .
A: Consider then .
25: Give an example where it's neither.
A: Consider . . But this is neither subset nor superset of .
26: Why is continuity defined at a point and uniform continuity defined on an interval?
A: Continuity allows you to pick a different for each point, allowing you to have continuity at a single point. Uniform continuity needs to have a interval share the same value of .
27: What is a smooth function, and give an example one.
A: A smooth function is infinitely differentiable. All polynomials are smooth.
28: Prove differentiability implies continuity.
A: Differentiability implies . Now multiply both sides by , taking advantage of limit rules. so we get which means .
29: Use L'Hospital's Rule to evaluate .
A: We clearly see that the limits of the top and bottom go to infinity, so we can use L'Hospital's Rule. Taking derivative of top and bottom, we get which goes to .
30: 5.1 Prove that if is an isolated point in , then is automatically continuous at .
A: Briefly, no matter what is chosen, we can just choose a small enough neighborhood such is within the neighborhood. Then all (i.e., just c) in the neighborhood have .