Chapi Dev Talks
To Shade some light how big the csv files are. π€―
Based on @frectonz recommendation to change it to sqlite it might get me a huge performance on processing part of the big csv, since file size doesn't matter for us but the speed is a huge gain for us.
plus there were a lot of duplication in the csv rows and we didn't notice that until today.
after a bit of experiment even tho the sqlite file size increased i think the query time is much faster than the normal looping so i think i am changing the approach a bit.
So the idea is to merge and process 4 csv file so i am going to change 3 csv to sqlite and looping through one csv and getting the file from other 3 might be the best approach i have at the moment.
just like
tho this doesn't help much for file downloading part but i think it's a good start for processing part.
anyways thanks @frectonz for the recommendation it super cool to have such community.
plus there were a lot of duplication in the csv rows and we didn't notice that until today.
after a bit of experiment even tho the sqlite file size increased i think the query time is much faster than the normal looping so i think i am changing the approach a bit.
So the idea is to merge and process 4 csv file so i am going to change 3 csv to sqlite and looping through one csv and getting the file from other 3 might be the best approach i have at the moment.
just like
for i in big_csv:
result_1 = cursor.execute(f"SELECT * FROM table WHERE id = {i}")
result_2 = cursor.execute(f"SELECT * FROM table WHERE id = {i}")
result_3 = cursor.execute(f"SELECT * FROM table WHERE id = {i}")
# do something with the result
tho this doesn't help much for file downloading part but i think it's a good start for processing part.
anyways thanks @frectonz for the recommendation it super cool to have such community.
β‘21π1
Forwarded from Hacker News
Show HN: Embed an SQLite database in your PostgreSQL table (Score: 150+ in 11 hours)
Link: https://readhacker.news/s/6icWC
Comments: https://readhacker.news/c/6icWC
pglite-fusion is a PostgreSQL extension that allows you to embed SQLite databases into your PostgreSQL tables by enabling the creation of columns with the `SQLITE` type. This means every row in the table can have an embedded SQLite database.
In addition to the PostgreSQL `SQLITE` type, pglite-fusion provides the `query_sqlite`` function for querying SQLite databases and the `execute_sqlite` function for updating them. Additional functions are listed in the projectβs README.
The pglite-fusion extension is written in Rust using the pgrx framework [1].
----
Implementation Details
The PostgreSQL `SQLITE` type is stored as a CBOR-encoded `Vec<u8>`. When a query is made, this `Vec<u8>` is written to a random file in the `/tmp` directory. SQLite then loads the file, performs the query, and returns the result as a table containing a single row with an array of JSON-encoded values.
The `execute_sqlite` function follows a similar process. However, instead of returning query results, it returns the contents of the SQLite file (stored in `/tmp`) as a new `SQLITE` instance.
[1] https://github.com/pgcentralfoundation/pgrx
Link: https://readhacker.news/s/6icWC
Comments: https://readhacker.news/c/6icWC
pglite-fusion is a PostgreSQL extension that allows you to embed SQLite databases into your PostgreSQL tables by enabling the creation of columns with the `SQLITE` type. This means every row in the table can have an embedded SQLite database.
In addition to the PostgreSQL `SQLITE` type, pglite-fusion provides the `query_sqlite`` function for querying SQLite databases and the `execute_sqlite` function for updating them. Additional functions are listed in the projectβs README.
The pglite-fusion extension is written in Rust using the pgrx framework [1].
----
Implementation Details
The PostgreSQL `SQLITE` type is stored as a CBOR-encoded `Vec<u8>`. When a query is made, this `Vec<u8>` is written to a random file in the `/tmp` directory. SQLite then loads the file, performs the query, and returns the result as a table containing a single row with an array of JSON-encoded values.
The `execute_sqlite` function follows a similar process. However, instead of returning query results, it returns the contents of the SQLite file (stored in `/tmp`) as a new `SQLITE` instance.
[1] https://github.com/pgcentralfoundation/pgrx
GitHub
GitHub - frectonz/pglite-fusion: Embed an SQLite database in your PostgreSQL table. AKA multitenancy has been solved.
Embed an SQLite database in your PostgreSQL table. AKA multitenancy has been solved. - frectonz/pglite-fusion
β‘20π₯6β€2π1
This is not related to tech at all but I urge you to find couple of minutes and read the below story.
https://www-bbc-com.cdn.ampproject.org/c/s/www.bbc.com/amharic/articles/c2e714vekk1o.amp
I really am out of word at this point. May God help us and follow the right path.
Out kids might live in this country at least for most people and do we really give this to our kids.
Hopefully our generation will bring the good out of humanity.
Thank you for all of you who reads this. π
https://www-bbc-com.cdn.ampproject.org/c/s/www.bbc.com/amharic/articles/c2e714vekk1o.amp
I really am out of word at this point. May God help us and follow the right path.
Out kids might live in this country at least for most people and do we really give this to our kids.
Hopefully our generation will bring the good out of humanity.
Thank you for all of you who reads this. π
BBC News α ααα
βα°α ααα αα ααα α¨α«α ααα₯α αα αβ - α¨αα α ααΈα αα α α¨α αα ααα΅ - BBC News α ααα
ααα¦α΅ 2015 α.α. α¨α°ααΈαα α¨αα α ααΈα α αα α₯ααα½α α«α΅αα£α£ αααααͺα«α α¨αα α¨αααα α΅ααα΅ αα αα’ ααα€ α¨α αα΅ ααα΅ α¨αααα
α αα΅ α°α αα α«α³ααα»αΈαα ααα΅ α α°ααα¨α° αααααͺα« αα αα’α’α² α αααα α°ααα«αα½α’ α¨α’α’α² αα α αα α«α΅ ααα α«α ααα³α€ α΅αα°α ααα½α α΅ αααα΅ α₯α α΅αα³ααα»αΈα αα α ααα΅ α αααα α°αα«αα½α’ α¨α ααα αα» α¨αα£α½α α΅ αααα΅α α α΅αα΅α α αααβ¦
π24
Me going out to office from home(aka around semit fiyel bet)
Me arrived at the office (aka 22)
Me go upstairs 4 floors fyi no lift
Me realising I forgot my office key Infront of the door π
Me now drinking coffee eventho I have to work trying to decide what to do ππ(aka anqi coffee)
Me arrived at the office (aka 22)
Me go upstairs 4 floors fyi no lift
Me realising I forgot my office key Infront of the door π
Me now drinking coffee eventho I have to work trying to decide what to do ππ(aka anqi coffee)
π41π4π₯1
Please open Telegram to view this post
VIEW IN TELEGRAM
YouTube
I Meet MrBeast To Break The Internet!!
Cristiano Ronaldo meets the biggest Youtuber and Jimmy answers the question everyone is asking: βAm I Gonna Beat You?β. Big challenges to come on the 30th!!!
π₯11π4π1π€―1
Samson Endale πͺπΉ
Get ready for Black Friday π₯
How i love black Friday sales.
it is already started and since i am working heavily on US sites and other sites i think i needed a strong VPN which proton VPN best at it.
https://protonvpn.com/blackfriday
i was tempted to go for Proton Unlimited which
Anyways if you are want to buy something and was waiting for discount this is your chance.
it is already started and since i am working heavily on US sites and other sites i think i needed a strong VPN which proton VPN best at it.
https://protonvpn.com/blackfriday
Billed at $35.88 for the first 12 months best deal so far i think.i was tempted to go for Proton Unlimited which
Billed at $77.88 for the first 12 months.Anyways if you are want to buy something and was waiting for discount this is your chance.
Proton VPN
VPN Black Friday deals: VPN discounts | Proton VPN
Save on a secure, high-speed VPN to stream videos, unblock content, and protect your browsing from surveillance with the best Black Friday VPN deals.
π₯1
Forwarded from Tech Nerd (Tech Nerd)
π4
α¨ WebFlow ααα΅ α«αα ααααα α°α α₯α£ααα αα° @SophiServebot ααα₯αα΅ ααα© α₯α Small Task(α΅αα½ αα°α« α΅α« α αα) plus ααα°αα± αα α΅α«α ααα αα½ααα‘α‘
Max 1 hr bihon new so please text on the bot your username.
very very small task.
Task Detail:
yehone website ale esu lay and page weyim demo and section form mechemer new keza. i will send you the fields. formu submit sidereg yemihedibet aws lambda ale keza success message masayet new.
lela form pagu lay silale copy paste new mostly
Max 1 hr bihon new so please text on the bot your username.
very very small task.
Task Detail:
yehone website ale esu lay and page weyim demo and section form mechemer new keza. i will send you the fields. formu submit sidereg yemihedibet aws lambda ale keza success message masayet new.
lela form pagu lay silale copy paste new mostly
Webflow
Webflow: Create a custom website | Visual website builder
Create custom, responsive websites with the power of code β visually. Design and build your site with a flexible CMS and top-tier hosting. Try Webflow for free.
π3π₯2
Got a question for android nerds is there any good network monitor application you know?
Please send playstore link π
trying
Please send playstore link π
trying
PCAPdroid - network monitor as of now but would love to know if there is any good onesπ1
Happy Thanks giving they say so if anybody is celebrating
Happy thanksgivingβ€8π6
Make sure to check if you have 2FA added in your important applications if not set up today.
i recommend using Google Authenticator Playstore | Appstore but feel free to use any kind of authenticators.
i have set it up in almost all the application i use so this is a friendly recommendation
i recommend using Google Authenticator Playstore | Appstore but feel free to use any kind of authenticators.
i have set it up in almost all the application i use so this is a friendly recommendation
Google Play
Google Authenticator - Apps on Google Play
Enable 2-step verification to protect your account from hijacking.
β€9