Java Hyd Team
746 subscribers
986 photos
39 videos
670 files
690 links
https://teamhydteam.my.canva.site/

Can visit us on our website ๐Ÿ˜Š
Still working on it ๐Ÿ˜Š
Download Telegram
insert into table_name
(date_field)
values
(to_date(sysdate, 'yyyy/mm/dd hh24:mi:ss'));

The value is inserted as 08-02-12 12:00:00. In this query, it always stores the default time as 12 a.m.
Can reach us on linkedin
Can reach me personally here ๐Ÿ˜Š
๐Ÿ‘1
๐Ÿš€ 7 Data Engineering Projects for FREE!

Don't Burst Your Head !!

๐Ÿ‘จ๐Ÿปโ€๐Ÿ’ป Here are the 7 Projects that you can start this weekend


1. Building Data Model and Writing ETL Job - https://lnkd.in/dQSm-d_k

Data modeling is an essential part of Data Engineering, DO NOT SKIP THIS!!!

What will you learn?
โœ… Python
โœ… SQL
โœ… Building Data Models
โœ… Basics of DBMS
โœ… Writing ETL Job
โœ… Querying Data Programmatically
โœ… PostgreSQL


2. ETL Pipeline on AWS Cloud - https://lnkd.in/d4iy9Dgd

If have no idea about Cloud Computing then this project is for you

What will you learn?
โœ… Python
โœ… SQL
โœ… Cloud Computing Basics
โœ… AWS Services - Athena, Glue, Redshift, S3, IAM
โœ… Creating Data Pipeline

3. Covid Data Analysis Project - https://lnkd.in/d2u4tS3R

This will be your first end-to-end Data Engineering project on Covid-19 Data

What will you learn?
โœ… Python
โœ… SQL
โœ… Building Data Model
โœ… AWS Services - Athena, Glue, Redshift, S3, IAM
โœ… Creating Data Pipeline
โœ… PostgreSQL


4. YouTube Data Analysis (End-To-End Data Engineering Project) - https://lnkd.in/dS8FwupT

This is a 3-hour long project where you will execute a complete Data Engineering project

What will you learn?
โœ… Python and PySpark
โœ… SQL
โœ… How to understand the business problem
โœ… AWS Services - Athena, Glue, Redshift, S3, IAM, Lambda, Quicksight
โœ… Building Data Pipeline and Scheduling it

5. Twitter Data Pipeline using Airflow - https://lnkd.in/dkwdmPnS

If you are someone who wants to learn the basics about Airflow and how to build a data pipeline this project is for you

What will you learn?
โœ… Python
โœ… Basics of Airflow
โœ… Working with Twitter Data and Package - Tweepy
โœ… Python Package - Pandas
โœ… Writing ETL job and storing data on S3

6. Extract Data From Amazon Website - https://lnkd.in/dccEasSH

Learn how to extract data from one source and build a dataset from it.
What will you learn?
โœ… HTML Basics
โœ… Web Scraping fundamentals
โœ… Python
โœ… Packages (BeautifulSoup, Pandas, Numpy)
โœ… How to build a CSV file

7. Stock Market Real-Time Data Analysis using Kafka, AWS, and Python - https://lnkd.in/dWSjqcFf

What will you learn?
โœ… Build a Real-Time simulation app using Python
โœ… Understand the basics of Kafka (Broker, Producer, Consumer, Zookeeper, and many more)
โœ… How install Kafka on EC2 (or any VM)
โœ… Write Producer and Consumer code in Python
โœ… Generate a real-time streaming pipeline and store data in S3
โœ… Analyze Data in Real-Time using Athena

Credit Darshil Parmar for this Amazing Post !! This Guy is Doing a Amazing Job for the DE Folks out there !!

Tagging W3Schools.com as well for these best Resources !!


Tagging Neel shah , Suraz G. , POOJA JAIN , Arif Alam , Ashish Patel ๐Ÿ‡ฎ๐Ÿ‡ณ


#dataengineering #dataengineer #dataanalytics #bigdata #dataanalysis #datasciences #sql #server #datasciences #python #data #pandas #business #html #aws #project #building #amazon #covid #projects #cloud #cloudcomputing #writing #career #stockmarket #pipeline #streaming #comment
๐Ÿ‘1
๐Ÿš€ Empower your career with data engineering skills and secure your dream job in this growing fieldโš™๏ธ

โœ”๏ธ After receiving a lot of queries, I've made some revisions to my original suggestion and I highly recommend following this exact sequence. Trust me, it will make things much easier for you.

โ™ป๏ธ It's easy to get lost in the vast amount of information available when it comes to learning new skills, especially in the field of data engineering.

๐Ÿ”— However, with a solid roadmap and some dedication, it is possible to enter the field of data engineering in 2023.

Here are some steps you can follow to make sure you're on the right track -

๐Ÿ”ถ Learn RDBMS, NoSQL databases, SQL, and data warehousing concepts :

As a data engineer, you'll be working with large amounts of data stored in databases. Familiarize yourself with different types of databases and how to query them using SQL. Learn one RDBMS and one NoSQL database, then familiarize yourself with data warehousing concepts.

1. Learn Data Warehousing concepts - https://lnkd.in/eKnVbFAB
2. Learn MySql - https://lnkd.in/efk-Mi3c
3. Learn and practice SQL - https://lnkd.in/efMKFkfX
4. Learn Azure Cosmos DB - https://lnkd.in/eNVyc6Mq
   
๐Ÿ”ถ Learn Python and PySpark :

These are essential tools for data engineers.

1. Python: https://lnkd.in/e5rCbvP8
2. PySpark : https://bit.ly/3Vu34Ev

๐Ÿ”ถ Learn Bash, Airflow and Kafka :

These tools will help you automate and streamline data processing tasks. You will also lear how to create data pipelines.๐Ÿ”ฉ

https://lnkd.in/eyN6u2yd

๐Ÿ”ถ Learn Git and the basics of CICD :

These skills will help you work collaboratively on data engineering projects and ensure smooth deployment.

Git - https://lnkd.in/eX_Q8s99
Basics of CICD - https://lnkd.in/epKGivFY

๐Ÿ”ถ Learn Azure Databricks and Data Lakes :

Azure Databricks - https://lnkd.in/eBij4akJ
Learn Data Lakes - https://lnkd.in/eQ9xxAJT

๐Ÿ‘‰ Create a standout resume by showcasing your skills and experience in data engineering.

๐Ÿ‘‰ Enhance your portfolio by completing various data engineering projects and sharing them on GitHub.

๐Ÿ‘‰ Seek out opportunities in data engineering by applying to relevant positions

Optional Learning -

1. Learn Data Structure and Algorithms
2. Learn AWS or Azure services dedicated for data engineering works.
   
By following these steps and dedicating yourself to learning and gaining experience, you can become a data engineer in 2023. Good luck on your journey!

I have created a Telegram channel for sharing knowledge and have included the link in the comments section.

๐Ÿ“Œ If you like my posts, please follow https://www.linkedin.com/groups/14161672 ๐Ÿ‡บ๐Ÿ‡ธ ๐ŸŒ๐ŸŒ and hit the ๐Ÿ”” on my profile to get a notification for all my new posts.

๏ปฟ#dataengineering #nosql #hadoop #datastructures #sql #algorithms #bigdata #business #python #data #programming #mysql #database #aws #spark #github #azure #job #career #learning #opportunities #experience #resume #engineer #warehousing
Those who worked on banking application can use this
Q4.) What is the module in project banking application? How many number of modules used in your project? On which module you worked in your project?

A4.) The modules in a project banking application are typically related to the different functions of a bank, such as customer accounts, payments, transfers The exact number of modules used in my given project is dependent on the specific requirements of the project. I worked on the customer accounts module, which included features such as creating customer accounts, managing customer profiles, and monitoring customersโ€™ banking activity.
The modules in project banking application include:

1. Account Management
2. Money Transfer
3. Online Banking
4. Payments and Bill Management
5. Customer Support

We used 5 modules for our project. I worked mainly on the Account Management and Online Banking modules.
worked on the Account Management Module, which is responsible for managing the bank accounts of the users. This module was responsible for customer registration, account opening, account closure, account inquiry, account maintenance, and various other account related activities.