processing modules are activated, utilizing the SQLite storage:ClamAVProcessingJARMProcessingTLSHProcessingYARAProcessingIn addition to the SQLite storage module, a simple web UI was developed that allows viewing and managing the scanned domains and URLs.
___________________________
@hacking_Attack
@Hacking_Video
___________________________
@hacking_Attack
@Hacking_Video
Hacking Articles Tips Tricks Videos Tutorials
Photo
Hacking on Medium
Cyber Security Career Roadmap 2022
There are so many carrier opportunities in the cyber securities as a became ethical hacker. more than 3.0 million of job options are…
Continue reading on Medium »
___________________________
@hacking_Attack
@Hacking_Video
Cyber Security Career Roadmap 2022
There are so many carrier opportunities in the cyber securities as a became ethical hacker. more than 3.0 million of job options are…
Continue reading on Medium »
___________________________
@hacking_Attack
@Hacking_Video
Medium
Cyber Security Career Roadmap 2022
There are so many carrier opportunities in the cyber securities as a became ethical hacker. more than 3.0 million of job options are…
Hacking Articles Tips Tricks Videos Tutorials
Photo
Hacking on Medium
Hacking or ethical hacking for new steps
https://cdn-images-1.medium.com/max/600/0*SegYyKwtnlAVZ4ze.png
Ethical hacking is only part of man hacking but such education is used for the benefit of people and people.the task of ethical hacking is…
Continue reading on Medium »
___________________________
@hacking_Attack
@Hacking_Video
Hacking or ethical hacking for new steps
https://cdn-images-1.medium.com/max/600/0*SegYyKwtnlAVZ4ze.png
Ethical hacking is only part of man hacking but such education is used for the benefit of people and people.the task of ethical hacking is…
Continue reading on Medium »
___________________________
@hacking_Attack
@Hacking_Video
Medium
Hacking or ethical hacking for new steps
Ethical hacking is only part of man hacking but such education is used for the benefit of people and people.the task of ethical hacking is…
Hacking Articles Tips Tricks Videos Tutorials
Photo
Hacking on Medium
Hand Tracking and Virtual Mouse using Computer Vision
https://cdn-images-1.medium.com/max/1920/1*nk9Me4fsN5nd5O7-EaEc5g.jpeg
Track hand movements and create a virtual mouse using computer vision.
Continue reading on Medium »
___________________________
@hacking_Attack
@Hacking_Video
Hand Tracking and Virtual Mouse using Computer Vision
https://cdn-images-1.medium.com/max/1920/1*nk9Me4fsN5nd5O7-EaEc5g.jpeg
Track hand movements and create a virtual mouse using computer vision.
Continue reading on Medium »
___________________________
@hacking_Attack
@Hacking_Video
Medium
Hand Tracking and Virtual Mouse using Computer Vision
Track hand movements and create a virtual mouse using computer vision.
Hacking Articles Tips Tricks Videos Tutorials
Photo
Hacking on Medium
Career Opportunities in Ethical Hacking
https://cdn-images-1.medium.com/max/1280/1*VVkmVmjxhawbMWREKvkVug.png
Even though the role of ethical hackers has been in the industry for the past few years, demand for ethical hackers is soaring high right…
Continue reading on Medium »
___________________________
@hacking_Attack
@Hacking_Video
Career Opportunities in Ethical Hacking
https://cdn-images-1.medium.com/max/1280/1*VVkmVmjxhawbMWREKvkVug.png
Even though the role of ethical hackers has been in the industry for the past few years, demand for ethical hackers is soaring high right…
Continue reading on Medium »
___________________________
@hacking_Attack
@Hacking_Video
Medium
Career Opportunities in Ethical Hacking
Even though the role of ethical hackers has been in the industry for the past few years, demand for ethical hackers is soaring high right…
Hacking Articles Tips Tricks Videos Tutorials
Photo
Hacking on Medium
TryHackMe — Pickle Rick Çözümü
https://cdn-images-1.medium.com/max/889/1*9Vlu3vyjF4rM_bF06BWkYA.png
Bu yazımda TryHackMe’nin Pickle Rick adlı odasını nasıl çözdüğümü yazacağım. İngilizce kaynak çok fakat Türkçe kaynağın yetersiz olduğunu…
Continue reading on Medium »
___________________________
@hacking_Attack
@Hacking_Video
TryHackMe — Pickle Rick Çözümü
https://cdn-images-1.medium.com/max/889/1*9Vlu3vyjF4rM_bF06BWkYA.png
Bu yazımda TryHackMe’nin Pickle Rick adlı odasını nasıl çözdüğümü yazacağım. İngilizce kaynak çok fakat Türkçe kaynağın yetersiz olduğunu…
Continue reading on Medium »
___________________________
@hacking_Attack
@Hacking_Video
Medium
TryHackMe — Pickle Rick Çözümü
Bu yazımda TryHackMe’nin Pickle Rick adlı odasını nasıl çözdüğümü yazacağım. İngilizce kaynak çok fakat Türkçe kaynağın yetersiz olduğunu…
How i got Swag from Sony ?
All i can say it was accidental bug i found (low hanging fruit)Continue reading on Medium »
Read more...
All i can say it was accidental bug i found (low hanging fruit)Continue reading on Medium »
Read more...
How I Offered Free 1 Lakh Rupees Through Government Website?
https://infosecwriteups.com/how-i-offered-free-1-lakh-rupees-through-government-website-6c10e16130fc?source=rss------bug_bounty-5
___________________________
@hacking_Attack
@Hacking_Video
https://infosecwriteups.com/how-i-offered-free-1-lakh-rupees-through-government-website-6c10e16130fc?source=rss------bug_bounty-5
___________________________
@hacking_Attack
@Hacking_Video
Medium
How I Offered Free 1 Lakh Rupees Through Government Website?
Hey Hackers, It’s Me Krishnadev P Melevila, a 19-Year-old self-learned cyber security researcher.
Hey Hackers, It’s Me Krishnadev P Melevila, a 19-Year-old self-learned cyber security researcher.Continue reading on InfoSec Write-ups » (https://infosecwriteups.com/how-i-offered-free-1-lakh-rupees-through-government-website-6c10e16130fc?source=rss------bug_bounty-5)
___________________________
@hacking_Attack
@Hacking_Video
___________________________
@hacking_Attack
@Hacking_Video
Medium
How I Offered Free 1 Lakh Rupees Through Government Website?
Hey Hackers, It’s Me Krishnadev P Melevila, a 19-Year-old self-learned cyber security researcher.
All i can say it was accidental bug i found (low hanging fruit)Continue reading on Medium » (https://medium.com/@stark303/how-i-got-swag-from-sony-dc12c8ebb258?source=rss------bug_bounty-5)
___________________________
@hacking_Attack
@Hacking_Video
___________________________
@hacking_Attack
@Hacking_Video
Medium
How i got Swag from Sony ?
All i can say it was accidental bug i found (low hanging fruit)
Hacking Articles Tips Tricks Videos Tutorials
Photo
KitPloit - PenTest Tools!
SubCrawl - A Modular Framework For Discovering Open Directories, Identifying Unique Content Through Signatures And Organizing The Data With Optional Output Modules, Such As MISP
https://blogger.googleusercontent.com/img/a/AVvXsEiKG0jNOTd1otcGeHlNH1TcE4OoO5BFHiif67DfRlsJp0T1QgDw-tsKWckuK6dDfj4XwrtAQ6HN2juB0zdS8l3bXbzO6HsYA1FquwiO7hwUTsAVAIzYnqRkWWXQQ1cPpfASkpUX1uh82Wu5Zs0zSZYnl5ipXlM8IOX0-Z3LK9ZkORCUyrqiYwmYZZKGjQ=w640-h168 SubCrawl is a framework developed by Patrick Schläpfer, Josh Stroschein and Alex Holland of HP Inc’s Threat Research team. SubCrawl is designed to find, scan and analyze open directories. The framework is modular, consisting of four components: input modules, processing modules, output modules and the core crawling engine. URLs are the primary input values, which the framework parses and adds to a queuing system before crawling them. The parsing of the URLs is an important first step, as this takes a submitted URL and generates additional URLs to be crawled by removing sub-directories, one at a time until none remain. This process ensures a more complete scan attempt of a web server and can lead to the discovery of additional content. Notably, SubCrawl does not use a brute-force method for discovering URLs. All the content scanned comes from the input URLs, the process of parsing the URL and discovery during crawling. When an open directory is discovered, the crawling engine extracts links from the directory for evaluation. The crawling engine determines if the link is another directory or if it is a file. Directories are added to the crawling queue, while files undergo additional analysis by the processing modules. Results are generated and stored for each scanned URL, such as the SHA256 and fuzzy hashes of the content, if an open directory was found, or matches against YARA rules. Finally, the result data is processed according to one or more output modules, of which there are currently three. The first provides integration with MISP, the second simply prints the data to the console, and the third stores the data in an SQLite database. Since the framework is modular, it is not only easy to configure which input, processing and output modules are desired, but also straightforward to develop new modules. https://blogger.googleusercontent.com/img/a/AVvXsEh3anip4Zbigp_1Tq_6jJiMAXqyu3mx2ExTHHu9rHxKW4GtWUTtDCGKPKHVT1A7d8a8gFCowmq5FzhWJg7CgmXAyhec5zOM5VS-Cp6QPJmedrFIsXwoHpJQhoshUg6BZ8iyXzovN6lZtZRg9Jv3nfH6Tph1Q039NNW4px2o6s1P6QBPNj1UaNvK-MrwcQ=w640-h382 Figure 1 - SubCrawl architecture
SubCrawl supports two different modes of operation. First, SubCrawl can be started in a run-once mode. In this mode, the user supplies the URLs to be scanned in a file where each input value is separated by a line break. The second mode of operation is service mode. In this mode, SubCrawl runs in the background and relies on the input modules to supply the URLs to be scanned. Figure 1 shows an overview of SubCrawl’s architecture. The components that are used in both modes of operation are blue, run-once mode components are yellow, and service mode components are green. RequirementsBased on the chosen run mode, other preconditions must be met. Run-Once Mode RequirementsSubCrawl is written in Python3. In addition, there are several packages that are required before running SubCrawl. The following command can be used to install all required packages before running SubCrawl. From the crawler directory, run the following command:
* Installing Do[...]
SubCrawl - A Modular Framework For Discovering Open Directories, Identifying Unique Content Through Signatures And Organizing The Data With Optional Output Modules, Such As MISP
https://blogger.googleusercontent.com/img/a/AVvXsEiKG0jNOTd1otcGeHlNH1TcE4OoO5BFHiif67DfRlsJp0T1QgDw-tsKWckuK6dDfj4XwrtAQ6HN2juB0zdS8l3bXbzO6HsYA1FquwiO7hwUTsAVAIzYnqRkWWXQQ1cPpfASkpUX1uh82Wu5Zs0zSZYnl5ipXlM8IOX0-Z3LK9ZkORCUyrqiYwmYZZKGjQ=w640-h168 SubCrawl is a framework developed by Patrick Schläpfer, Josh Stroschein and Alex Holland of HP Inc’s Threat Research team. SubCrawl is designed to find, scan and analyze open directories. The framework is modular, consisting of four components: input modules, processing modules, output modules and the core crawling engine. URLs are the primary input values, which the framework parses and adds to a queuing system before crawling them. The parsing of the URLs is an important first step, as this takes a submitted URL and generates additional URLs to be crawled by removing sub-directories, one at a time until none remain. This process ensures a more complete scan attempt of a web server and can lead to the discovery of additional content. Notably, SubCrawl does not use a brute-force method for discovering URLs. All the content scanned comes from the input URLs, the process of parsing the URL and discovery during crawling. When an open directory is discovered, the crawling engine extracts links from the directory for evaluation. The crawling engine determines if the link is another directory or if it is a file. Directories are added to the crawling queue, while files undergo additional analysis by the processing modules. Results are generated and stored for each scanned URL, such as the SHA256 and fuzzy hashes of the content, if an open directory was found, or matches against YARA rules. Finally, the result data is processed according to one or more output modules, of which there are currently three. The first provides integration with MISP, the second simply prints the data to the console, and the third stores the data in an SQLite database. Since the framework is modular, it is not only easy to configure which input, processing and output modules are desired, but also straightforward to develop new modules. https://blogger.googleusercontent.com/img/a/AVvXsEh3anip4Zbigp_1Tq_6jJiMAXqyu3mx2ExTHHu9rHxKW4GtWUTtDCGKPKHVT1A7d8a8gFCowmq5FzhWJg7CgmXAyhec5zOM5VS-Cp6QPJmedrFIsXwoHpJQhoshUg6BZ8iyXzovN6lZtZRg9Jv3nfH6Tph1Q039NNW4px2o6s1P6QBPNj1UaNvK-MrwcQ=w640-h382 Figure 1 - SubCrawl architecture
SubCrawl supports two different modes of operation. First, SubCrawl can be started in a run-once mode. In this mode, the user supplies the URLs to be scanned in a file where each input value is separated by a line break. The second mode of operation is service mode. In this mode, SubCrawl runs in the background and relies on the input modules to supply the URLs to be scanned. Figure 1 shows an overview of SubCrawl’s architecture. The components that are used in both modes of operation are blue, run-once mode components are yellow, and service mode components are green. RequirementsBased on the chosen run mode, other preconditions must be met. Run-Once Mode RequirementsSubCrawl is written in Python3. In addition, there are several packages that are required before running SubCrawl. The following command can be used to install all required packages before running SubCrawl. From the crawler directory, run the following command:
$ sudo apt install build-essential
$ pip3 install -r requirements.txt Service Mode RequirementsIf SubCrawl is started in service mode, this can be done using Docker. For this reason, the installation of Docker and Docker Compose is required. Good installation instructions for this can be found directly on the Docker.com website.* Installing Do[...]
Hacking Articles Tips Tricks Videos Tutorials
KitPloit - PenTest Tools! SubCrawl - A Modular Framework For Discovering Open Directories, Identifying Unique Content Through Signatures And Organizing The Data With Optional Output Modules, Such As MISP https://blogger.googleusercontent.com/img/a/AVvXsE…
cker Engine
* Installing Docker Compose Getting HelpSubCrawl has built-in help through the -h/--help argument or by simply executing the script without any arguments.
* ClamAVProcessing
* JARMProcessing
* TLSHProcessing
* YARAProcessing
In addition to the SQLite storage module, a simple web UI was developed that allows viewing and managing the scanned domains and URLs. https://blogger.googleusercontent.com/img/a/AVvXsEhxRLLLT2NQ65IwSOZ9AtxISHxSyoxW9E_AIruZ9DAuIZQbYZzbsoqCSM7HPeejcoH2aMvBcPIkryCP9-8wCv4g2az2RF6w43DHWkfZLsqoo05HaO_pVn7qiVJdLYAvkC5XvzBS4yfRpuG2OEA2XRY85ZfD7Vnyalx_gCZ0nH1-peLPd3kbU95Zlh3R_Q=w640-h260 However, if this UI is not sufficient for the subsequent evaluation of the data, the MISP storage module can be activated alternatively or additionally. The corresponding settings must be made in
The following two commands are enough to clone the GIT repository, create the Docker container and start it directly. Afterwards the web UI can be reached at the address
* Installing Docker Compose Getting HelpSubCrawl has built-in help through the -h/--help argument or by simply executing the script without any arguments.
******** ** ****** **
**////// /** **////** /**
/** ** **/** ** // ****** ****** *** ** /**
/*********/** /**/****** /** //**//* //////** //** * /** /**
////////**/** /**/**///**/** /** / ******* /** ***/** /**
/**/** /**/** /**//** ** /** **////** /****/**** /**
******** //******/****** //****** /*** //******** ***/ ///** ***
//////// ////// ///// ////// /// //////// /// /// ///
~~ Harvesting the Open Web ~~
usage: subcrawl.py [-h] [-f FILE_PATH] [-k] [-p PROCESSING_MODULES] [-s STORAGE_MODULES]
optional arguments:
-h, --help show this help message and exit
-f FILE_PATH, --file FILE_PATH
Path of input URL file
-k, --kafka Use Kafka Queue as input
-p PROCESSING_MODULES, --processing PROCESSING_MODULES
Processing modules to be executed comma separated.
-s STORAGE_MODULES, --storage STORAGE_MODULES
Storage modules to be executed comma separated.
Available processing modules:
- ClamAVProcessing
- JARMProcessing
- PayloadProcessing
- TLSHProcessing
- YARAProcessing
Available storage modules:
- ConsoleStorage
- MISPStorage
- SqliteStorage Run-Once ModeThis mode is suitable if you want to quickly scan a manageable amount of domains. For this purpose, the URLs to be scanned must be saved in a file, which then serves as input for the crawler. The following is an example of executing in run-once mode, not the -f argument is used with a path to a file. python3 subcrawl.py -f urls.txt -p YARAProcessing,PayloadProcessing -s ConsoleStorage Service ModeWith the service mode, a larger amount of domains can be scanned and the results saved. Based on the selected storage module, the data can then be analyzed and evaluated in more detail. To make running the service mode as easy as possible for the user, we built all the functionalities into a Docker image. In service mode, the domains to be scanned are obtained via Input modules. By default, new malware and phishing URLs are downloaded from URLhaus and PhishTank and queued for scanning. The desired processing and storage modules can be entered directly in the config.yml. By default, the following processing modules are activated, utilizing the SQLite storage:* ClamAVProcessing
* JARMProcessing
* TLSHProcessing
* YARAProcessing
In addition to the SQLite storage module, a simple web UI was developed that allows viewing and managing the scanned domains and URLs. https://blogger.googleusercontent.com/img/a/AVvXsEhxRLLLT2NQ65IwSOZ9AtxISHxSyoxW9E_AIruZ9DAuIZQbYZzbsoqCSM7HPeejcoH2aMvBcPIkryCP9-8wCv4g2az2RF6w43DHWkfZLsqoo05HaO_pVn7qiVJdLYAvkC5XvzBS4yfRpuG2OEA2XRY85ZfD7Vnyalx_gCZ0nH1-peLPd3kbU95Zlh3R_Q=w640-h260 However, if this UI is not sufficient for the subsequent evaluation of the data, the MISP storage module can be activated alternatively or additionally. The corresponding settings must be made in
config.ymlunder the MISPsection.The following two commands are enough to clone the GIT repository, create the Docker container and start it directly. Afterwards the web UI can be reached at the address
https://localhost:8000/. Please note, once the containers have started the input modules will begin to add URLs to the processing queue and the engine will begin crawling hosts. git clone https://github.com/hpthreatresearch/subcrawl.git
docker-compose up --build SubCrawl ModulesInput ModulesInput modules are only used in service mode. If SubCrawl started using the run-once mode then a file containing the URLs to scan must be supplied. The following two input modules have been [...]