Day 03: Advanced File Manipulation & Scavenger Pipelines

Day 03 · Lunch — Advanced File Manipulation & Scavenger Pipelines

⚡ 60-Second Mental Model (Student Digest)

╔══════════════════════════════════════════════════════════════════════════════╗
║  ZOTHOS × 1NC0GN30 // LINUX FILESYSTEM & SHELL EXECUTION ARCHITECTURE       ║
╠══════════════════════════════════════════════════════════════════════════════╣
║                                                                              ║
║   [ USER TERMINAL / TUI ]  ──( stdin 0 )──►  [ BASH / ZSH SHELL PARSER ]     ║
║                                                       │                      ║
║                                              ( glibc / syscalls )            ║
║                                                       ▼                      ║
║   [ VFS / INODE TABLE ]    ◄───────────────  [ LINUX KERNEL RING 0 ]         ║
║     ├── /bin  (Core Binaries)                  ├── Process Scheduler         ║
║     ├── /etc  (System Configs)                 ├── Memory Manager            ║
║     ├── /home (Operator Workspaces)            └── Netfilter / I/O           ║
║     └── /var  (Logs & Runtime State)                                         ║
╚══════════════════════════════════════════════════════════════════════════════╝

---

Welcome to Day 3 Lunch! Today, we will dive deeper into file and directory management with a focus on creating, copying, moving, renaming files, and navigating directories. We'll also cover some advanced tasks to help solidify your skills.

Topics Covered

Create, Copy, Move, and Rename Files

Creating Files

- touch filename.txt
Creates an empty file named filename.txt. If the file already exists, it updates its timestamp.

- echo 'content' > filename.txt
Creates a file named filename.txt with the specified content. If the file already exists, it overwrites its content.

Copying Files

- cp source.txt destination.txt
Copies the file source.txt to destination.txt. If destination.txt already exists, it will be overwritten.

- cp -r source_dir/ destination_dir/
Recursively copies the directory source_dir and its contents to destination_dir.

Moving and Renaming Files

- mv oldname.txt newname.txt
Renames oldname.txt to newname.txt. If the target file exists, it will be overwritten.

- mv file.txt /path/to/destination/
Moves file.txt to the specified directory /path/to/destination/. It can also rename the file if a new name is provided.

Additional Commands

- cp -i source.txt destination.txt
Copies source.txt to destination.txt with an interactive prompt to confirm overwriting.

- mv -i oldname.txt newname.txt
Renames or moves oldname.txt to newname.txt with an interactive prompt to confirm overwriting.

Directory Navigation and Manipulation

Navigating Directories

- cd /path/to/directory
Changes the current directory to /path/to/directory.

- cd ..
Moves up one directory level.

- cd ~
Changes to the home directory of the current user.

Creating and Removing Directories

- mkdir directory_name
Creates a new directory named directory_name.

- mkdir -p parent/child
Creates nested directories parent and child. The -p flag ensures that parent directories are created if they do not exist.

- rmdir directory_name
Removes an empty directory named directory_name.

- rm -r directory_name
Recursively removes a directory and its contents.

Additional Commands

- cd -
Switches to the previous directory.

- ls -R
Lists all files and directories recursively.

File Management Scavenger Hunt

Finding Files

- find /path -name '*.txt'
Finds all files with the .txt extension in the specified path.

- find /path -type f -size +1M
Finds all files larger than 1 MB in the specified path.

Searching File Content

- grep 'pattern' filename.txt
Searches for the specified pattern in filename.txt.

- grep -r 'pattern' /path/to/dir/
Recursively searches for pattern in all files within /path/to/dir/.

Managing Files

- mv file1.txt /backup/
Moves file1.txt to the /backup/ directory.

- cp -u file1.txt /backup/
Copies file1.txt to /backup/ only if file1.txt is newer than the existing file in /backup/.

- rm -i file1.txt
Removes file1.txt with an interactive prompt to confirm deletion.

Practice Questions

1. Create a file named testfile.txt with content 'Test Content'.
- Command: echo 'Test Content' > testfile.txt

2. Copy testfile.txt to a directory named backup/.
- Command: cp testfile.txt backup/

3. Rename testfile.txt to renamedfile.txt and move it to backup/.
- Command: mv testfile.txt backup/renamedfile.txt

4. Recursively copy the backup/ directory to archive/.
- Command: cp -r backup/ archive/

5. Navigate to the /etc directory.
- Command: cd /etc

6. Create a directory structure /data/archive/2024.
- Command: mkdir -p /data/archive/2024

7. Change the permissions of /data to 755.
- Command: chmod 755 /data

8. Display the size of the /home/user directory.
- Command: du -sh /home/user

9. Remove the /data/archive/2024 directory and all its contents.
- Command: rm -r /data/archive/2024

10. Find all .log files in /var/log.
- Command: find /var/log -name '*.log'

11. Search for the pattern 'Error' in /var/log/syslog.
- Command: grep 'Error' /var/log/syslog

12. Move a file named report.txt from /home/user/ to /archive/.
- Command: mv /home/user/report.txt /archive/

13. Create a backup of report.txt in /backup/ without overwriting existing files.
- Command: cp -u /home/user/report.txt /backup/

14. Remove report.txt from /archive/ interactively.
- Command: rm -i /archive/report.txt

---

Great job on completing Day 3 Lunch! You've explored advanced file and directory management techniques, and tackled a variety of real-world scenarios. Keep practicing to master these commands and enhance your Linux skills.

Day 03 · Dinner — Advanced File Manipulation & Scavenger Pipelines

⚡ 60-Second Mental Model (Student Digest)

╔══════════════════════════════════════════════════════════════════════════════╗
║  ZOTHOS × 1NC0GN30 // LINUX FILESYSTEM & SHELL EXECUTION ARCHITECTURE       ║
╠══════════════════════════════════════════════════════════════════════════════╣
║                                                                              ║
║   [ USER TERMINAL / TUI ]  ──( stdin 0 )──►  [ BASH / ZSH SHELL PARSER ]     ║
║                                                       │                      ║
║                                              ( glibc / syscalls )            ║
║                                                       ▼                      ║
║   [ VFS / INODE TABLE ]    ◄───────────────  [ LINUX KERNEL RING 0 ]         ║
║     ├── /bin  (Core Binaries)                  ├── Process Scheduler         ║
║     ├── /etc  (System Configs)                 ├── Memory Manager            ║
║     ├── /home (Operator Workspaces)            └── Netfilter / I/O           ║
║     └── /var  (Logs & Runtime State)                                         ║
╚══════════════════════════════════════════════════════════════════════════════╝

---

Welcome to the Day 3 dinner study guide!

* In this session, we will review and expand upon the concepts covered in Day 3 breakfast and lunch. We'll dive deeper into file and directory management, including advanced commands and variations.
1. Creating Files

Commands:

touch: Create an empty file or update the timestamp of an existing file.
cat: View and concatenate file contents.
echo: Create files with content directly from the command line.

Examples:

touch newfile.txt                          # Create an empty file named 'newfile.txt'
cat file1.txt file2.txt > combined.txt    # Combine the content of 'file1.txt' and 'file2.txt' into 'combined.txt'
echo "Hello, World!" > hello.txt          # Create a file named 'hello.txt' with the content "Hello, World!"

Description:

touch is commonly used to create files quickly or update their modification time.
cat can be used to view file contents or combine multiple files into one.
echo is useful for creating files with specific content directly from the command line.

2. Copying Files

Commands:

cp: Copy files or directories from one location to another.
rsync: Synchronize files and directories between two locations.

Examples:

cp file.txt backup/                       # Copy 'file.txt' to the 'backup' directory
cp -r dir1/ dir2/                        # Recursively copy 'dir1' and its contents to 'dir2'
rsync -avz source/ destination/          # Synchronize files from 'source' to 'destination' with verbose output
rsync --delete source/ destination/     # Synchronize files and delete those no longer in 'source'

Description:

cp allows for simple copying of files and directories. The -r option enables recursive copying of directories.
rsync is more powerful, supporting synchronization of files and directories with options for verbosity and deletion.

3. Moving and Renaming Files

Commands:

mv: Move or rename files and directories.
rename: Rename multiple files using a pattern.

Examples:

mv oldfile.txt newfile.txt               # Rename 'oldfile.txt' to 'newfile.txt'
mv file.txt /path/to/destination/        # Move 'file.txt' to the specified directory
rename 's/.txt/.bak/' *.txt              # Rename all '.txt' files to '.bak'

Description:

mv is used for both moving files and directories and renaming them.
rename is useful for batch renaming files based on patterns, leveraging Perl regular expressions.

4. Navigating Directories

Commands:

cd: Change directories.
pwd: Print the current working directory.
find: Search for files and directories.

Examples:

cd /home/user                          # Change to the '/home/user' directory
pwd                                    # Print the current directory path
find /path/to/search -name "*.txt"     # Find all '.txt' files under the specified path
find . -type f -exec ls -lh {} \;     # List details of all files found in the current directory

Description:

cd changes the current working directory.
pwd helps you know your current location in the directory hierarchy.
find is a powerful tool to search for files and directories with various criteria.

5. Advanced File Operations

Commands:

ln: Create hard and symbolic links.
stat: Display file or file system status.
file: Determine file type.

Examples:

ln -s /path/to/original /path/to/link   # Create a symbolic link to the original file
stat file.txt                           # Display detailed status information about 'file.txt'
file file.txt                           # Determine and display the type of 'file.txt'

Description:

ln creates links to files or directories, with -s for symbolic links.
stat provides comprehensive information about file attributes.
file helps identify the type of a file based on its content.

6. Combining Commands

Commands:

xargs: Build and execute command lines from standard input.
tee: Read from standard input and write to standard output and files.
awk: Pattern scanning and processing language.

Examples:

find . -name "*.log" | xargs rm       # Find and delete all '.log' files
echo "Hello, World!" | tee hello.txt  # Write "Hello, World!" to 'hello.txt' and also output to the terminal
awk '{print $1}' file.txt             # Print the first field of each line in 'file.txt'

Description:

xargs is useful for constructing and executing command lines from input data.
tee allows simultaneous writing to files and output to the terminal.
awk is a powerful text processing tool for extracting and manipulating data.

Summary

* Day 3 dinner ties together all the concepts from breakfast and lunch with an emphasis on advanced commands and their variations. Mastering these commands will provide a robust foundation for effective file and directory management in Linux. Practice each command thoroughly and explore additional options and variations to enhance your proficiency.

Feel free to refer to the examples and descriptions provided to reinforce your understanding and skills. Happy learning!