Load huge or large files into MySQL database
Subhadip Mukherjee
by Subhadip
1y ago
Load very large file in the MySQL database table using mysql in built bulk load utility and python and using a very local computer. I am using 8 GB of RAM and 4 core domestic processor. Step 1: Install required libraries: Python library required: mysql-connector-python pip3 install mysql-connector-python OR pip install mysql-connector-python Step 2: Setting the variables: Data File: You need to specify data file with path. Delimiter: Specify the delimiter. Example, ‘,’ or ‘\t’ New Line (Line Termination) Character: Specify the character. Header: specify this as True always. This tut ..read more
Visit website
PDF manipulation with Python: Part 1
Subhadip Mukherjee
by Subhadip
2y ago
Under the hood If you are a coder and comfortable with python, there are many libraries by which you can manipulate PDF file as your own wish. Here are some list of python library which can be used to create or edit PDF files: PDFMiner – This tool is to extract text data from a PDF file, along with its position and other information like fonts or lines etc. It can convert the PDF to other formats such as HTML. It comes with command line utility which is useful for non-programmer. PyPDF4 – It is a pure python library capable of splitting, merging, cropping and transforming PDF pages. It can ..read more
Visit website
Scraping YouTube with BeautifulSoup and Python3
Subhadip Mukherjee
by Subhadip
2y ago
There are few ready made YouTube video download library present in python already. “youtube-dl” is one of them which is very convenient to use. It also has command line interface (CLI) to download video from YouTube hence you do not need to use python code to download video. This article is for some more details. In the subsequent sections as we make progress, we will know the details of the source code of the YouTube video page. We will scrape the most important and required content of the YouTube video page. Technology [Read library] used to do this operations: Python – We are going to scra ..read more
Visit website
Build your own email tracker using PHP-MySQL
Subhadip Mukherjee
by Subhadip
2y ago
Sometimes tracking email is useful to know if the recipient received an email and whether they opened the same. There are some free and paid solution is already available in the market. In this post, I am writing to describe the strategy of tracking email using popular technology PHP and MySQL database. Use Cases Email tracking can be useful for many reasons. It is useful for marketing purpose to get some insight like if the promotional emails are getting hit or not. Another insight might be useful to know the customers who are the active recipient. Beside email opening information we also get ..read more
Visit website
Some cool yet advance and hidden features of Python
Subhadip Mukherjee
by Subhadip
2y ago
Python has really some great features which make some tasks easier to write from the coding perspective. Sometimes these features called as hidden features as these are either very unique to Python or not very well known. For…Else loop Comparison operator chaining Slicing/Extended slicing Multiple Assignment Value Swapping Argument unpacking / Star operator Yield Statement for…else Loop Yes, you saw it right, python has for…else loop if we use break statement inside for loop. If the for loop completes without invoking the break statement, then else block executed. Consider below example: Sea ..read more
Visit website
Download image from Instagram Post Link
Subhadip Mukherjee
by Subhadip
2y ago
Instagram doesn’t allow you to download an image from the app or its website. Even on the website, you can’t get the image related options in the context menu(right-click): Other sites (including this blog) Instagram Context Menu There are few ways to get the image from the Instagram. I am going to describe the easiest way of doing the same. Get the post link: Click on the three dot on the top right side of the post and click on the “Copy Link”. Click on the “Copy Link” to get the post link If you already have the post link then ignore this step and proceed to step 2. 2. Get the image link ..read more
Visit website
Prevent GNOME auto sleep
Subhadip Mukherjee
by Subhadip
2y ago
Recent update in Kali linux is having one problem with the auto suspend operation. Even the power settings are perfect (Automatic suspend = Off), the computer sleeps every 20 minutes. Steps to perform to disable auto sleep: cd /usr/share/gdm/dconf vi 90-debian-settings Search for below parameters, uncomment if commented. Set the value to 0. sleep-inactive-ac-timeout=0 sleep-inactive-battery-timeout=0 Once done, run below command to refresh the settings: dconf compile /var/lib/gdm3/greeter-dconf-defaults /usr/share/gdm/dconf The issue should be resolved !! If not, please comment below ..read more
Visit website
AWK commands equivalent to SQL query – Data manipulation
Subhadip Mukherjee
by Subhadip
2y ago
Introduction Data Warehouse and Business Intelligence involves all about data handling for business insights, we often very much rely on the SQL query to do data analysis and analytics. We can achieve the same through some BI tools as well. But if we are comfortable with SQL then I am sure that you will prefer to write quick query rather than designing something in tool. The only requirement if you want to use SQL is, you need database with SQL capability. Again, if you have data, still most of the environment has database so it should not be a problem. So open SQL editor and write query, you ..read more
Visit website
Few online free tools
Subhadip Mukherjee
by Subhadip
2y ago
Here is the list of few online tools you can use for free. They have premium option as well for advanced features. But these tools are very user friendly, free, watermark free and useful on the go. Photo design / Infographics editor / photo editor There are lots of options available over the internet. https://www.canva.com/ – very good tool for the photo editing, designing. It has lot of free features and premium features as well. Free features are enough for normal use. This site is add free. Hence the screen is very clean and clear. https://pixlr.com/editor/ – It has lot of features as well ..read more
Visit website
Class mysqli not found error after upgrading to php 7.3
Subhadip Mukherjee
by Subhadip
2y ago
The problem seems to be related to the fact that after PHP 7.2 or PHP 7.3 is installed, the version of PHP 7.0 still continues to be used. And in spite of the fact that extensions, for example such as php7.0-mysql, do not disappear from the system, but they cease to be picked up by the PHP interpreter and the server can no longer fully work with PHP code. The simplest way that will solve this problem is disabling PHP 7.0 for Apache and enabling PHP 7.2 for the web server, since in any case PHP 7.3 is installed automatically. To do this, execute: sudo a2dismod php7.0 sudo a2di ..read more
Visit website

Follow Subhadip Mukherjee on FeedSpot

Continue with Google
Continue with Apple
OR