LU Decomposition LU decomposition is a common method to solve polynomial \(Ax=b\), and this method is consist of three steps: LU factorization: Gaussian elimination on matrix \(A\), factorize \(A\) to \(L,U\) such th 2022-04-14 Mathematics Linear Algebra
Introduction to Docker-Compose Docker-Compose is used to manage your containers, kind of like a container steward. We write a file, declare the container to be started in this file, configure some parameters, execute this file, Doc 2022-04-13 Data Engineering Docker
Basic Use of Docker Docker is an open source application container that allows developers to package their applications and dependencies into a portable engine, and then publish them to operating system such as Linux or 2022-04-13 Data Engineering Docker
Norms and Condition Number Norm is a function from a real or complex vector space to the non-negative real numbers that behaves in certain ways, which can be used to measure the size of vectors (vector norm) and matrices (matri 2022-03-28 Mathematics Linear Algebra
Subspace In Linear Algebra, linear subspace is also known as vector subspace, which is a subset of a larger vector space. A linear subspace is normally called as subspace when the context serves to distinguish 2022-03-27 Mathematics Linear Algebra
Run Word-Count Example of Hadoop (Python Version) While Hadoop/MapReduce is based on Java, it is not necessary to use Java to write the mapper and reducer. The Hadoop framework provides the “Streaming API”, which lets us use any command line executab 2022-02-16 Data Engineering Hadoop
Run Word-Count Example of Hadoop (Java Version) The main content of this blog is introducing how to run word count example by Hadoop and Java on the cloud, including set up the Hadoop configuration, generate and adjust the Java code for Hadoop, and 2022-02-15 Data Engineering Hadoop
Show the Hidden File on Mac OS Sometimes we might need to edit the hidden file on Mac such as the configuration file but we don't know the path of this file. Therefore, letting the computer shows the hidden file allows us to locate 2022-01-29 Data Engineering Mac
Use SSH to connect the virtual machine on cloud and run jupyter notebook on it In this blog, I will introduce how to create a virtual machine on openstack (it's a cloud platform), and then using SSH to connect the virtual machine with local computer. After the connection, I will 2022-01-21 Data Engineering Virtual Machine
Install and Control Different Version of Python on Mac The default version of Python installed on the Mac OS is 2.7, and if we intall Anaconda, the version 3.7 of Python would overwrite the version 2.7 to become the default version of Python in the comput 2022-01-16 Data Engineering Python