Skip to content

ajeyln/python_learn_forever

Repository files navigation

MODULES and TECHNIQUES

Table of Content

Background

Python is a programming language and has many concepts and modules. These are used for scripting, data science, and web development etc.

In this repository I have identified some important modules for future references

This will be constantly updated with relative exercises to get Handson experience

Content

pandas

Pandas is a Python Module for working with Data frames. The folder contains my notes and exercises for your reference.

I have referred Pandas Tutorial

The Module is very helpful to implement the algorithms of Data Sciecne and Machine Learning.

Also for better understanding, I have solved some python puzzles from 101 Pandas Exercises for Data Analysis

PEP8

PEP8 is a document that provides guidelines and best practices on how to write Python code.

I have created notes with help of the link PEP-8 Tutorial

This document gives coding conventions for the Python code comprising the standard library in the main Python distribution

visual_studio_editor

We need an IDE - Integrated Development Environment for working with scripts, data and commands.

For our development work, I have chosen Visual Studio Code Editor from Microsoft for an IDE

visual_studio_editor folder contains my notes, which are prepared with reference from Visual Studio Code Tutorial- Udemy by James Quick

custom_module

Python modules can get access to code from another module by importing the file/function using import method.
The import statement is the most common way of invoking the import machinery

There are mainly two types(Absolute & Relative) of imports in Python

Based on the types of imports in Python, I have created 3 situation in this folder and imported libraries files from source file.

The note created based on the link Absolute and Relative imports

pylint

Pylint is a tool that checks for errors in Python code, tries to enforce a coding standard.
It can also look for certain type errors and recommend suggestions about how particular blocks can be refactored.
The code is given an overall mark, based on the number and severity of the warnings and errors

I have referred Pylint Tutorial Guide

The folder contains my notes and exercises for your reference.

python_virtual_environment

Python applications will often use packages and modules that don’t come as part of the standard library. Applications will sometimes need a specific version of a library, That's why we need Python virtual enviornment
Python virtual environments is to create an isolated environment for Python projects.This means that each project can have its own dependencies

I have referred Python Virtual Enviroment Tutorial

The folder contains installation steps,and an exercise for your reference.

pytest

pytest is a mature full-featured Python testing tool that helps us to write better programs.
The pytest framework makes it easy to write small tests, yet scales to support complex functional testing for applications and libraries.

The Module is very helpful for testing scripts
The folder contains my notes and exercises for your reference.

logging

Logging is a very useful tool. It helps us to develop a better understanding of the flow of a program and discover scenarios.

Logs provide developers with an extra set of information that are constantly looking at the flow. It can store information, like If an error occurs, then they can provide more insights than a stack trace.

I have referred Python Logging Basic & Advanced by Corey Shafer

The folder contains my notes and exercises for your reference.

Database - CRUD Operations

A database is simply an organized collection of persistance storage of data. Databases arrange information in such a way that any specific piece of information can be easily accessed.
A database contains the data or information for the database are stored in uniquely identifier called tables abd these are comprised of columns and rows. Columns contain attributes for the column such as column name, data type etc.Rows contain the records or data for the columns.

There are mainly two types of databases

  1. SQL database
  2. No SQL databases In this folder, we are working on SQL based databases.

Database query is a tool to access data from a database to manipulate or retrieve datas
This allows us to perform logic with the information and we get in response to the query

Based on method of quering, There will be two types of operational method

  1. Manual Operation
  2. Programmin Operations

File Operation(OS, SYS, CSV)

File is defined as a set of related data or information.
Folders help us to keep our files organized and separate and folder can have sub folders as well

In this folder, we have created file and folder operation based on following modules

  1. os - The OS module in Python provides functions for interacting with the operating system. OS comes under Python’s standard utility modules. This module provides a portable way of using operating system dependent functionality.
  2. sys - The python sys module provides functions and variables which are used to manipulate paths of the Python Runtime Environment.
  3. csv (Comma Seperated Value) - The csv library contains objects and other code to read, write, and process data from and to CSV formatted files.

To-Dos

  1. functools (module)
  2. json related module with python
  3. request module
  4. flask api concept
  5. Decorators
  6. pipfile
  7. pdb - Python debugging
  8. boto3 - Advance programming with AWS
  9. AWS powertools - Advance programming with AWS

References

For reference, please find the link from python Programming by Tarek Ziadé.

Useful Links

Sl. No. Link Remarks
1 Pandas Tuorial Pandas Fundamentals and Tutorial
2 PEP8 Tutorial Guide Guide for PEP8
3 Naming Convesion Naming convesion method in python Script
4 Visual Studio Visual Studio Code Tutorial
5 Emmet Tutorial Emmet Tutorial
6 Edit Config Coding Style Tutorial
7 Sys path append module Tutorial to add file path
8 System path and Changing Module Paths System path and Changing Module Paths
9 Pylint Tuorial Pylint Tutorial
10 Pylint Tutorial Guide Begginer's Guide for Pylint
11 Python Virtual Enviroment Guide Python Virtual Environment Guide
12 Python Virtual Enviroment Tutorial Python Virtual Enviroment Tutorial
13 Pytest Tutorial Pytest Tutorial
14 Pytest Tutorial - 2 Pytest Tutorial
15 Pytest Tutorial - 3 Pytest Tutorial
16 Pytest Code Coverage Pytest Code Coverage Tutorial
17 Logging Basic Python logging - Basic Tutorial
18 Logging Advanced Python logging - Advanced Tutorial
19 Pytest Logging Python logging Tutorial
20 Pytest Logging Logging for Pytest
21 SQLITE3 SQLITE Tutorial

Contact :

For any feedback, queries Please send Email to ajeyanayak@gmail.com🌟

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors