Hacks

MySQL on DSL

2016-09-02T03:59:45+00:00

4/11/2010

I've recreated this page to support a more logical and portable installation of the latest MySQL GA source release in DamnSmallLinux and to package it as an extension.

Executed with DSL-4.4.10 live CD loaded to the command prompt with the boot option command "dsl 2". Because I'm running the live CD, there's no hard drive so if you intend to do the same, you will need about 650 MB Ram to build MySQL. You can also use a hard drive but that's outside the scope of this tutorial.
Work out of the /opt directory so as to have space.
1. cd /opt
To compile MySQL you need to add some compiler tools to the system. You don't have to use wget, but I kept copies on my own local FTP server so that I could easily start over. Gcc1-with-libs.dsl and gnu-utils.dsl are both available in the MyDSL Browser. Mysql src came from www.mysql.org.
1. wget ftp://[someserver]/mysql-5.1.45.tar.gz
2. wget ftp://[someserver]/gcc1-with-libs.dsl
  1. http://distro.ibiblio.org/pub/linux/distributions/damnsmall/mydsl/system/gcc1-with-libs.dsl
  2. you can install from the command line with "mydsl-wget gcc1-with-libs.dsl system"
3. wget ftp://[someserver]/gnu-utils.dsl
  1. http://distro.ibiblio.org/pub/linux/distributions/damnsmall/mydsl/system/gnu-utils.dsl
  2. you can install from the command line with "mydsl-wget gnu-utils.dsl system"
Install the utilities (skip this if you used the browser)
1. mydsl-load gcc1-with-libs.dsl
2. mydsl-load gnu-utils.dsl
3. tar xvzf mysql-5.0.67.tar.gz
Clean up (for space)
1. rm -f gcc1-with-libs.dsl
2. rm -f gnu-utils.dsl
3. rm -f mysql-5.0.67.tar.gz
Compile mysql. "make -j4" and "sudo make install -j4" are for multiple processors. You may do better removing "-j4". Adjust your .configure options as you see fit.I'm putting everything into the /opt/mysql directory so this needs to be configured during the build.
1. cd mysql-5.1.45
2. ./configure --prefix=/opt/mysql --without-debug --without-man --without-docs --without-bench --without-innodb --without-ndb-test --without-ndb-debug --disable-dependency-tracking
3. make -j4
4. sudo make install -j4
Clean up (for space)
1. cd /opt
2. rm -Rf mysql-5.1.45
To make your DSL extension have an "out of the box" startup configuration, add this script to /opt/mysql as "dsl-setup.sh" or use the steps to get your database up and runnin
1. sudo ln -s /opt/mysql/bin/* /opt/bin/
2. #enable the man symlinks of you have man
3. #sudo ln -s /opt/mysql/share/man/man1/* /usr/share/man/man1/
4. #sudo ln -s /opt/mysql/share/man/man8/* /usr/share/man/man8/
5. sudo adduser --system mysql
6. sudo addgroup mysql
7. sudo adduser mysql mysql
8. sudo cp /opt/mysql/share/mysql/mysql.server /etc/init.d
9. sudo cp /opt/mysql/share/mysql/my-small.cnf /etc/my.cnf
10. sudo update-rc.d mysql.server defaults
11. sudo mkdir /opt/mysql/var
12. sudo /opt/bin/mysql_install_db
13. sudo chgrp -R mysql /opt/mysql
14. sudo chown -R mysql /opt/mysql
15. sudo chmod -R u+wrx /opt/mysql
16. sudo /etc/init.d/mysql.server start
Make it executable
1. chmod +x /opt/mysql/dsl-setup.sh
Move to the FS root to package the extension.
1. cd /
2. tar -cvzf /ramdisk/mysql_5.1.45.dsl /opt/mysql
To install this extension on another DSL box
1. mydsl-load mysql_5.1.45.dsl
2. sudo /opt/mysql/dsl-setup.sh

Want to do something dangerous to get root access to mysql from the network? From the mysql prompt:

mysql> GRANT ALL on *.* to 'root'@'%' identified by 'y0urPassw0rD';

Rotate tomcat logs

2016-09-02T03:59:30+00:00

If you want Tomcat to automatically rotate/cycle catalina.out with the date then do the following:

Find and edit the file: catalina.sh

change:

CATALINA_OUT="$CATALINA_BASE"/logs/catalina.out

to:

CATALINA_OUT="$CATALINA_BASE"/logs/catalina.`date +%Y-%m-%d`.out

Note:

Be sure you are editing the correct file as many different installs may use their own catalina.sh or even rename it and move it to /etc/init.d. Windows users may have to find work-arounds for the date function.

Apache Reverse Proxy

2016-09-02T03:59:02+00:00

Why do you need a reverse proxy?

In a normal case, you may have one public IP address, and 4 servers behind your firewall. One is serving mail, one is a database, one is a web server, and the last is a DNS server. You want all of these servers to share your public IP address, and resolve to names like:
1.    database.yourdomain.com
2.    mail.yourdomain.com
3.    www.yourdomain.com
4.    fullyqualifiedns.yourdomain.com
Another case is when you have several different types of services that you would rather host on the same port rather than fowarding all types of different ports through your firewall/router. For example, you have a Tomcat web container for your JSP pages, IIS for your ASP pages, and Apache for your PHP pages. I realize that there are plugins to get IIS to serve all of these documents, but how much fun is that? Also, I've learned that Apache HTTP is the best PHP webserver on any platform.
Note: if you are running IIS, you WILL have all kinds of other problems when attempting to install a reverse proxy... especially IIS6. You may have to disable Windows' socket pooling.http://support.microsoft.com/kb/813368 and http://support.microsoft.com/kb/238131

A reverse proxy will make this possible. You can have one public IP address and several(multiple) internal IP addresses(hosts) and have them all available on the internet. {Forgive the redundancy of the previous sentence... I needed to use some words that would make this page easy to find in a search engine as most people looking for this solution would not know to type "reverse proxy."} The solution I have played with is Apache's HTTP server which can be configured as a reverse proxy.

Magic DVD Ripper – Execute Error

2016-09-02T03:58:49+00:00

For Magic DVD Ripper, when you have gotten a confirmation that your registration code has been accepted, sometimes the application will stop working and ask you for the code repeatedly. If you do not have a valid copy of MDR, do not attempt this.

To reset the application after a full reinstall, delete the following key in your registry:

HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\ALP\option

You will usually see this error: "Register Code is not correct! We strongly recommend you copy/paste it."

For Windows XP x64:

HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Microsoft\ALP\option

This fix applies (at least) to v5.2.1.

Creating Video for Sansa Fuze

2016-09-02T03:58:39+00:00

Since the Sansa Media Converter does not like batch commands for larger media libraries, and because the files are rather large, I've created a listing of the video parameters that you need to setup in Avidemux to create videos that will play on the Fuze.

Video

Codec 4CC: DX50
Image Size: 224 x 176
Aspect Ratio: 1:1
Frame Rate: 20.000
Global Motion Compensation: No
Packed Bitstream: No
Quarter Pixel: No

Audio

Codec: MP3
Chanels: Stereo
Bitrate: 16000 Bps / 128 kbps
Variable Bitrate: No
Frequency: 44100 Hz

link

ffmpeg Cheat Sheet

2016-09-02T03:58:09+00:00

Input Devices

List dshow input devices

ffmpeg -list_devices true -f dshow -i dummy

Capture from an input device and output to a file that splits every five minutes

ffmpeg -f dshow -i audio="Microphone (2- High Definition " -map 0 -codec:a libmp3lame -f segment -segment_time 300 out%4d.mp3

GM Infotainment Video Conversion

2016-09-02T03:57:17+00:00

I have a 2011 GM Vehicle with an in-dash Infotainment system that plays AVI/DivX files. Unfortunately, most of my AVI files do not play correctly on the system, or not at all. I get errors like "File format not supported," or the resolution would be miss matched, or even the sound would be horrible.

My goal is to create a batch file that utilizes open-source projects to re-encode my movies to a consistent sound and video format that will work in the vehicle.

Analize input video
1. Need to know the width, height
2. Maybe" how many audio streams (to preserve more than 2 channels, each channel will have to be split into it's own wav file, normalized, then recombined)
3. Maybe: detect for English stream, discard others.
4. Maybe: detect sub titles and discard or keep
Rip the audio streams from it
Edit the audio streams
1. Signal level compression/expansion of the audio streams
2. Signal level normalization of the audio streams
Re-encode the video and recombine with the audio
1. The DivX codec will work with MPEG4 but I'm looking for a way to use H.264
2. Force FourCC to be DX50
3. Force the resolution to be 720x480 (use 720x432 to fill the entire screen) even though the screen is 800x480
4. Force the G.O.P. to 15 (group of pictures is the number of frames before a keyframe)
5. Force 0 B-Frames (while H.264 takes full advantage of B-Frames, this particular DivX player does not). What is a B-Frame? A B-Frame is a file-size optimization mechanism for H.264 (and other codecs) that only stores the bitmap changes from a previous frame as apposed to storing the entire frame. When areas of a video remain constant for several seconds, this can save a considerable amount of space. The DivX profile of the player is supposed to be "Home Theater" which should support 1 B-Frame, but I have not had much success using FFMPEG+MPEG4. I will keep investigating with H.264. Edit: FFMPEG+MPEG4 has to run in a single thread to encode B-Frames.
6. Reduce the video bit rate... since the screen is small and I would like to cram 8 full length movies onto a single 4GB DVD. 400KB/s is a good mix of quality and size.

This process would take a considerable amount of time for each video, so it would best exist inside a single batch file that can accept parameters. To process multiple files, I'd just create another batch file that will go down the list, or possible use a command-line for loop to process every video in a particular directory.

When burning, make sure to use ISO/Joliet format for the data DVD... I have had mixed/poor results with UDF discs of all versions.

The projects that I am using will be Windows versions:

http://www.ffmpeg.org/ Download here: http://ffmpeg.zeranoe.com/builds/
http://sox.sourceforge.net/ Download here: http://sourceforge.net/projects/sox/files/sox/

Check Back Later for more updates.

Usage: filename.bat inputVideoFileName outputVideoFileName videoKBPS [ffmpeg pathToffmpeg] [sox pathToSox]

Example: filename.bat "StarTrek.mkv" "StarTrekForCar.avi" 300 ffmpeg c:\ffmpeg\bin\ffmpeg.exe sox c:\sox\sox.exe

echo off

REM These variables exist only within this file execution
setlocal

REM Change to the batch file directory, where FFMPEG and SOX are located
cd %~dp0

set inputFileName=%1
set outputFileName=%2
set vbr=%3
set width=0
set height=0
set duration=0
set ffmpeg=ffmpeg.exe
set sox=sox.exe

REM Test input parameters
IF %1.==. GOTO Usage
IF %2.==. GOTO Usage

IF %3.==. GOTO Usage
echo %3| findstr /r "^[1-9][0-9]*$">nul
IF ERRORLEVEL 0 GOTO Parameter4
echo Invalid Bitrate
goto Usage

:Parameter4
IF %4. == ffmpeg. GOTO UpdateFFMPEG4
IF %4. == sox. GOTO UpdateSox4
:Parameter6
IF %6. == ffmpeg. GOTO UpdateFFMPEG6
IF %6. == sox. GOTO UpdateSox6

:Continue

if not exist "%ffmpeg%" (
echo Can not find ffmpeg binary: %ffmpeg%
goto Usage
)

if not exist "%sox%" (
echo Can not find Sox binary: %sox%
goto Usage
)

if not exist "%inputFileName%" (
echo Can not find input file: %inputFileName%
goto Usage
)

REM this is the command to print the file information
set info=ffprobe -v quiet -show_format -show_streams -of default %inputFileName%

REM get the input video width
for /f "delims=" %%a in ('%info% ^| findstr "width"') do @set width=%%a
set width=%width:~6%

REM get the input video height
for /f "delims=" %%a in ('%info% ^| findstr "height"') do @set height=%%a
set height=%height:~7%

REM get the input video duration
for /f "delims=" %%a in ('%info% ^| findstr "duration"') do @set duration=%%a
set duration=%duration:~9%

echo Input Video Dimensions: %width%x%height%
echo Input Video Duration : %duration%

set audioFileOriginal=temp1.%outputFileName%.wav
set audioFileFinal=temp2.%outputFileName%.wav
del %outputFileName% > NUL
del %audioFileOriginal% > NUL
set vid_opts=-vcodec mpeg4 -vb %vbr%k -acodec libmp3lame -filter:v scale=720:480 -vtag DX50 -f avi -ab 128k -g 15 -bf 1 -map 0:0 -map 1:0
set com_opts=-ac 2 -threads 1 -y -r 30

REM - Get audio
%ffmpeg% -i %inputFileName% -vn %com_opts% %audioFileOriginal%

REM process audio through sox. We want to reduce the
REM dynamic range with compand and normalize the volume
%sox% %audioFileOriginal% %audioFileFinal% compand 0.3,1 6:-70,-60,-20 -5 -90 0.2 norm

REM todo
REM Calculate the scale for video encoding
REM create a chapter every 10 minutes

REM Recombine video and audio
%ffmpeg% -i %inputFileName% -i %audioFileFinal% %vid_opts% %com_opts% %outputFileName%

Goto CleanExit

REM these are "functions
:Usage
echo
echo Usage: inputFileName outputFileName bitrate [ffmpeg location] [sox location]
echo [ffmpeg location] ie: ffmpeg "c:\ffmpeg\bin\ffmpeg.exe"
echo [sox location] ie: ffmpeg "c:\sox\sox.exe"
goto DirtyExit

:UpdateFFMPEG4
if %5.==. goto LocationErrorFFMPEG
set ffmpeg=%5
goto Parameter6

:UpdateSox4
if %5.==. goto LocationErrorSox
set sox=%5
goto Parameter6

:UpdateFFMPEG6
if %7.==. goto LocationErrorFFMPEG
set ffmpeg=%7
goto Continue

:UpdateSox6
if %7.==. goto LocationErrorSox
set sox=%7
goto Continue

:LocationErrorFFMPEG
echo FFMPEG requires a path.
goto Usage

:LocationErrorFFMPEG
echo Sox requires a path.
goto Usage

REM Clean up temp files
:CleanExit
del %audioFileOriginal% > NUL
del %audioFileFinal% > NUL

:DirtyExit

Reinitialize Mysql System Tables on Windows

2016-09-02T03:57:01+00:00

Sometimes I like to just delete everything in MySQL and start over. This is easy in Linux when you have the packaged script "mysql_install_db.pl" but we need to do it in Windows too.

After you delete everything in the \data directory, go to the command prompt, from your MySQL \bin directory:

mysqld --skip-grant-tables

Then open a new command prompt in the \bin directory and connect to your instance:

mysql

>create database mysql;

>use mysql;

>\. ..\share\mysql_system_tables.sql

>\. ..\share\mysql_system_tables_data.sql

>exit

Now, shutdown your server daemon:

mysqladmin shutdown

You should be able to restart the daemon:

mysqld

and login as root to begin configuring your permissions:

mysql -uroot

Netbeans on Linux

2016-09-02T03:56:13+00:00

If Netbeans or Java Studio Creator 2 (JSC) don't have any display elementes after installing in Linux, be sure to make this setting in the /etc/netbeans.conf or /etc/creator.conf file before you go crazy.

add "-J-Dawt.toolkit=sun.awt.motif.MToolkit" to the netbeans_default_options

netbeans_default_options="-J-Xms96m -J-Xmx384m -J-XX:PermSize=32m -J-XX:MaxPermSize=128m -J-XX:+CMSClassUnloadingEnabled -J-XX:+CMSPermGenSweepingEnabled -J-Xverify:none -J-Dnetbeans.javacore.background_scanning=true -J-Dsunappsrvint.home=/home/isaac/sun/Creator2_1/SunAppServer8 -J-Dawt.toolkit=sun.awt.motif.MToolkit"

Spelljammer Cheat

2016-09-02T03:56:00+00:00

After starting a new game, save it, then open the .PTY file in a Hex editor.

Change the x000075 and x000076 offsets to "ff ff" for $16mil