Unix usage tips blog

What this blog is about?

2012-07-12T18:29:00.005+04:00

Use search and labels cloud for navigating old content
(old content there actually outdated and incomplete).

If you need details on your problem related to content,
please contact me.

Consalting services now provided for fee.

On cygwin

2010-10-13T23:46:00.002+04:00

Cygwin in short, provides unix compatibility layer over the windows.

Once it is installed, you can use it's terminal (called from menu Start->Programs->Cygwin Bash Shell) .

I recommend this solution for those, who uses Windows, but from time to time needs unix shell inside, just because it is more convinent for some tasks, or for those who want to learn unix, but likes, or have to live under Windows.

services

2009-07-07T06:37:00.002+04:00

I am interested in business partnership and also can provide specific services:

I provide:

1) E-mail based consulting services (Unix's, Web, UI).
2) I provide my expert opinion as a service.
3) Practical, goal oriented text and numeric data analysis.

Feel free to contact.

GNU/Linux: copy , organize and rename all files in directrory with new mask.

2009-07-05T11:53:00.010+04:00

On this page, presented simple how-to for GNU/Linux newbie, that can be used for renaming files, for example photos in one directory.

This script will also work for other GNU/Linux's.
Please, be very accurate, to not lost all your files!

I have a set of folders, and each folder, contain some digital photo's.

the structure is like following:


~/
 Pictures/
    |
    +------- Folder1
               +---- Picture1.jpg
               +---- Picture2.jpg
               +---- Picture3.jpg
    +------- Private <--- this folder have to be excluded.
    |
    +------- Folder2 
    |
    +------- Folder3

I want to rename photo's and to put them into separate folder named AllPicts.

I also want to have the new name of file being concatenation (sum) of folder name and just some unique figure. For example Folder1/Picture1.jpg can be copied into AllPhotos/Folder1_1.jpg by this schema.

How to:

1) Start terminal. Alt-F2, xterm.

2) In terminal,
Prepare folders,

 
cd ~/Pictures
mkdir AllPhotos

check if you have enough space


du -sk
df

do renaming and organizing:


a=0 
for i in `find ./ -type d | sed "s/^\.\///" | egrep -v "^$" | egrep -v ^Private$`
do cd $i
echo $i
for j in `ls -1 | egrep -i \.*\.jpg`
do cp $j ~/Pictures/AllPhotos/$i$a.jpg
let a=(a+1) 
done 
cd ~/Pictures/
done

Please be very patient in using and modifying of script.
to avoid lost data or trashed disk.

It is better to understand and check your man pages for meaning of commands in script,

From the other side, if you understand script, than it is probably
easy for you to modify this script for your needs.

Clear space on blogger page

2009-06-20T11:59:00.009+04:00

Practically, too much gadgets (much more than the height of web page) look very ugly.

The simplest way to save space is remove gadgets that actually never used by users.

For example, If you are really doesn't need followers, and satisfied with people, who found you through search engine, than you don't need funny followers gadget, that actually makes page ugly.

Another way is making some blocks invisible, until users really need them.

On the right of this blog, there is the string "[+]unhide my info".

If the reader of the blog really need info, he can click and unfold this information.
All information from list or text gadget could be packed there.

How to make existing text and list packed into html/javascript box foldable (hidden)?

For my case, I just enveloped the existing text in following HTML/javascript code:


<div id="div_contacts" onmouseover=
"javascript:div_contacts.style.cursor=pointer;"
 style="color:#0000FF;cursor:pointer;cursor:hand" onclick=
"javascript:switch_direction()
"><b>[+] unhide my info and legal notice</b></div><
span id="my_contacts" style="display:none">
<pre>
<b>your text/list/links there
</b>

</span>

<script type="text/javascript">
function switch_direction(direction)
{
var val = document.getElementById("div_contacts");
if(val.innerHTML=="<b>[+] unhide my info and legal notice</b>")
{
val.innerHTML="<b>[-] hide my info and legal notice<b>";
var val2=document.getElementById("my_contacts");
val2.style.display="";
}
else
{
val.innerHTML="<b>[+] unhide my info and legal notice</b>";
var val2=document.getElementById("my_contacts");
val2.style.display="none";
};
}
</script>

tested with firefox 3

On testing.

2009-05-16T23:56:00.007+04:00

Glenford Myers - "The Art of Software Testing"

Very good book.

Every paragraph could be cited.

Example cite:

"
In an ideal world, we would want to test every possible permuta-
tion of a program. In most cases, however, this simply is not possible.
Even a seemingly simple program can have hundreds or thousands of
possible input and output combinations. Creating test cases for all of
these possibilities is impractical. Complete testing of a complex appli-
cation would take too long and require too many human resources to
be economically feasible."

From my experience, the design of a program could be also so complicated and not straightforward, that even coverage of all possible control flows with existing resources will be practically impossible.

And that way, there are no other way rather than redesign this program in "testable" way (by restructuring and simplifying internal structure).

3 unix tools for working with legacy code

2009-05-16T17:04:00.006+04:00

cflow
ctags
cscope
and 4th is vim:
vim

Connected together (through vim with refactor , taglist and cscope_maps) they can be combined into IDE.

chmod list of dirs (or files)

2009-05-16T12:16:00.016+04:00

I have list of dirs (generated by some find statement) that we want to grant rights to execute (go inside dir).

the problem with

# cat list | xargs chmod

intuitive one-line script is that it is not working.

Directories names in list contain spaces and ' " symbols and we have errors in directories processing doing that way.

Added slashes to get working script to grant rights to the files:

# cat list | sed 's/[\ '"'"'"]/\\&/g' | xargs chmod a+x

Fix network problems after upgrade laptop to Ubuntu 9.04 Jaunty Jackalope

2009-05-13T23:50:00.006+04:00

I have upgraded my Ubuntu(32-bit) version up to 9.04 (Jaunty Jackalope) on my HP Compaq 6720s laptop.

After upgrade, I got bluetooth working from the box, however I was not able to detect any network with NetworkManager. NetworkManager displayed absence of network availability, even with wired network working well.

After move to wicd tool for network connection and monitoring, I got wired and wireless networks working, and status of connection also displayed well.

What have I done:


$ sudo apt-get remove network-manager
$ sudo apt-get install wicd

reboot OS;

After reboot I have got new (wicd instead of network manager) icon for displaying network availability, and also ability to connect to wireless netowrk through wicd GUI like it was done before through network manager gui.

Left click on icon will provide you with panel of networks selection.

My laptop network cards, for which it is working:

~$ lspci | grep Netw
00:19.0 Ethernet controller: Intel Corporation 82562GT 10/100 Network Connection (rev 03)
10:00.0 Network controller: Intel Corporation PRO/Wireless 3945ABG [Golan] Network Connection (rev 02)

Testing with complexity bookmarks:

2009-04-20T23:51:00.002+04:00

http://hissa.nist.gov/HHRFdata/Artifacts/ITLdoc/235/sttoc.htm

http://checkstyle.sourceforge.net/index.html

ASN1C

2009-04-20T22:59:00.009+04:00

asn1c compiler generated code can not be build with c++ code by gcc with -WAll due to the asn1c compiler implementation does not not support full list of keywords, supported by modern c/c++ compilers.

example patch to go through the problem:


diff -uw libasn1compiler/asn1c_misc.c.old libasn1compiler/asn1c_misc.c
--- libasn1compiler/asn1c_misc.c.old 2009-04-20 22:56:12.000000000 +0400
+++ libasn1compiler/asn1c_misc.c 2009-04-20 22:58:47.000000000 +0400
@@ -16,7 +16,7 @@
  "enum", "union", "struct", "typedef", "class",
  "switch", "case", "default", "break", "continue",
  "if", "else", "do", "for", "while", "goto",
- "sizeof", "return"
+ "sizeof", "return", "and", "or", "not", "xor"
 };
 static int
 reserved_keyword(const char *str) {

Full patch published there

Code reviews and luck of requirements

2009-04-19T23:04:00.000+04:00

Code reviews with absence of requirements can not provide quality of software themself.

consider example of change:


main()
{
...
--- return ret;
+++ return 0;
}

If this code is ok?

It depends only from requirements.

The code is ok, if the code satisfied requirements, and not ok, if not.

Syntactic correctness actually tells nothing.

Strategy for legacy software system code redesign

2009-03-30T09:36:00.008+04:00

Basically, process of redesign of old existing software system can be presented as following sequence:

1) Define goal for redesign, and characteristics of system after redesign.

2) Cover by tests and measurements to measure degree of correspondence to characteristics defined.

3) Define methods for improvements.

4) Do redesign by methods defined in 3, keeping 2nd) tests and measurements.

5) If 1) goal of redesign achieved stop.

Other things, that should be kept during redesign, if you want to keep system live long after redesign done:

http://rgritsulyak.blogspot.com/2009/03/survivable-long-living-systems.html

Freemind 0.9 - > flash problems

2009-03-15T16:19:00.005+03:00

Strange, it is not working under FF, after been published.

Working well on local machine, but not working after publishing (even with html edited).

However, exported into java html works well.

searching for free software:

2009-03-15T16:15:00.004+03:00

Open storage engines.
- for analysis and comparison

for home
To avoid duplicates of photos on disk:
- clones controlling daemon.
- daemon in memory monitoring copies on external storages.

reading:

2009-03-10T09:30:00.004+03:00

UNIX Network Programming (Paperback)
by W. Richard Stevens (Author)

current reading

2009-03-10T09:08:00.002+03:00

The Design and Implementation of the FreeBSD Operating System [ILLUSTRATED] (Hardcover)
by Marshall Kirk McKusick (Author), George V. Neville-Neil (Author)

Understanding the Linux Kernel
By Daniel P. Bovet, Marco Cesati

Computing patterns in strings
By Bill Smyth, William Smyth

The Practice of Programming (ISBN 0-201-61586-X) by Brian W. Kernighan and Rob Pike

Database Tuning: Principles, Experiments, and Troubleshooting Techniques (The Morgan Kaufmann Series in Data Management Systems) (Paperback)
by Dennis Shasha (Author), Philippe Bonnet (Author)

Making algorithm for strings processing practical

2009-03-09T22:36:00.004+03:00

Well-known theoretical string processing algorithms presented in literature could be not practical, due to the symbol-by-symbol comparisons and processing used.

Modern processors have sse,sse2 (i.t.c.) extensions that allow process multiple data in the same time, as per-symbol.

To be practically optimized, algorithms should use not turing-machine based optimizations (theoretical), but be bazed on modern processors instruction sets.

Normalization of big tables by user

2009-03-09T22:28:00.007+03:00

Consider web application, processing User requests.

Generally Users is a table in such an application.

Other tables, that contain data releavent to the User (like personal user's posts, mail, financial transactions, e.t.c. ) , generally contain ID of such a user.

When we partition such tables by User ID, we can achieve performance by following parameters:

- Fast drop (or move to archive) user, and users data.
- If there are only several users at the moment on site, we can fill memory cache by only "logged in" users data, and process than this data also only in cache.
- More space, Faster user queries by removing indexes, and processing only data releavant to the user at the moment.

partitioning in Mysql limitation prevents some optimizations

2009-03-09T22:04:00.004+03:00

Mysql doesn't support following one big table optimization tip, discovered on Sybase trainings:

Place in memory "day" partition of table.
Store "Old" partitions on disk.

All partitions in Mysql 5.1.31 should be under one storage engine.

Searching for way to solve it by managing buffer sizes.

DB Performance testing framework.

2009-03-09T16:51:00.011+03:00

Example of architecture of testing framework for database:

Compilation-based:

1) get definition of database:
2) get (f)lex rules on database statements.
3) define testing profile (confioguration)
4) Write interpreter and tests builder (flex + yacc) based.


+-----------------------+      +---------------+
| DB statements syntax  |      | test profile  |
+-----------------------+      +---------------+
    ||                               ||
    ||                               ||
    \/                               \/
+---------+                    +-----------+
| flex    |                    |  yacc     |
+---------+                    +-----------+
      \\                             // 
       \\                           //
        \\                         //
         \\                       // 
          \|                     |/
+----+   +-------------------------+    +---------------+
| DB |==>|  test framework         |===>| test results  | 
+----+   +-------------------------+    +---------------+
                                              //
                                             //
                                            //
                                           |/
                                        +--------+
                                        | Graphs |
                                        +--------+

Interpretable:


+-----------------------+      +------------------------+
| DB statements syntax  |      | test processing rules  |
+-----------------------+      +------------------------+
    ||                               ||
    ||        +---------+            ||
    \/        | profile |            \/
+---------+   +---------+      +-----------+
| flex    |       ||           |  yacc     |
+---------+       \/           +-----------+
      \\      +---------+            // 
       \\     | dotconf |           //
        \\    +---------+          //
         \\       ||              // 
          \|      \/             |/
+----+   +-------------------------+    +---------------+
| DB |==>|  test framework         |===>| test results  | 
+----+   +-------------------------+    +---------------+
                                              //
                                             //
                                            //
                                           |/
                                        +--------+
                                        | Graphs |
                                        +--------+

Survivable long-living software systems.

2009-03-01T17:57:00.007+03:00

Following are just some notes on development of longer maintainable (more able to survive) software systems.

Looks like long-live of software system is not often market requirement, so "survivability" and adoption of software system is not requirement for "consumer" software products, like software in the box.

Consumers of boxed software, can uninstall old versions, buy new version of the box (or the box of competitor), and install it.

That way, due to the "instant" nature for such software, the critical are the parameters of the software on the time of software development.

However, service for "user groups", like corporations, has additional costs of "getting in" and "getting out". Users can be more conservative on service usage, just because of additional prices of "getting in" and "getting out". Migration has costs,and that way users are more conservative, and that way oriented on longer term goals.

For reasons listened, for services and other products like services, "long-term" quality of system parameters may probably define choice of customer, much more than "instant" parameters of software.

In real world, hardware, OS, environment, can change geographically and through time.

To be long-live and possible to survive under changing hardware, software, configuration, processed data, and other environment, software should be developed that way, to support
different hardware,OS, environment, e.t.c.

That way database based systems have more ability to survive, rather than handmade fine-tuned systems, designed for "current", i.e. actual on time of system development configuration and bounds of hardware, OS, data, e.t.c., because of various amount of tuning documented and tested tuning options.

Application's critical to capacity and performance that way should be planned to be adaptable to changing environment.

This should be applied to the whole process (for example, overcomplicated and undocumented code of the system has no chances to survive).

Also systems should be easily tuned/configured/changed when hardware/OS/environment bounds changed to use resources optimally.

Such system should be easily fixed, when it becomes IO/memory/processor/disk/network bound to efficiently use resources, and solve problems.

Ideally, installed system should adopt itself to changed environment without human effort.

Monitoring system bounds

2009-03-01T16:53:00.000+03:00

man sar
man bsdsar

Simple plotting with gnuplot

2009-01-25T02:38:00.003+03:00

from 1 column data of sequential var's:


gnuplot> plot 'data.dat' axes x1y2 with lines

from 2d (x and y)


gnuplot> plot 'data.dat' with lines

to output in external file:
ex1:


set terminal svg size 800 600
set out "test.svg"
plot sin(x)

ex2:


set terminal png size 800 600
set out "test.png"
plot 'c.dat' with lines

SVN: Load dump in

2009-01-24T22:09:00.002+03:00

create dump:


$ svnadmin dump OLD_REPO_PATH > dumpfile

restore on another machine:


$ svnadmin create ~/SVN_REPO
$ svnadmin load  ~/SVN_REPO/ < dumpfile

make first checkout


$ svn co file:///home/bugmaker/SVN_REPO/ .

Join all avi files in one

2009-01-19T00:08:00.005+03:00

join in 1 avi file from all found on card.

put files to join in one folder;

issue:

mencoder -forceidx -ovc copy -oac copy -o out.avi *.AVI

out.avi will be resulting file

current notes on net-snmp MIBs

2008-12-14T00:40:00.008+03:00

Go watch them online there:
http://www.net-snmp.org/docs/mibs/
Or simply snmptranslate through shell after installing snmp-tools:


# snmptranslate -Tp SNMPv2-MIB::snmpMIB

+--snmpMIB(1)
   |
   +--snmpMIBObjects(1)
   |  |
   |  +--snmpTrap(4)
   |  |  |
   |  |  +-- ---N ObjID     snmpTrapOID(1)
   |  |  +-- ---N ObjID     snmpTrapEnterprise(3)
   |  |
   |  +--snmpTraps(5)
   |  |  |
   |  |  +--coldStart(1)
   |  |  +--warmStart(2)
   |  |  +--linkDown(3)
   |  |  +--linkUp(4)
   |  |  +--authenticationFailure(5)
   |  |
   |  +--snmpSet(6)
   |     |
   |     +-- -RW- INTEGER   snmpSetSerialNo(1)
   |              Textual Convention: TestAndIncr
   |              Range: 0..2147483647
   |
   +--snmpMIBConformance(2)
      |
      +--snmpMIBCompliances(1)
      |  |
      |  +--snmpBasicCompliance(2)
      |  +--snmpBasicComplianceRev2(3)
      |
      +--snmpMIBGroups(2)
         |
         +--snmpSetGroup(5)
         +--systemGroup(6)
         +--snmpBasicNotificationsGroup(7)
         +--snmpGroup(8)
         +--snmpCommunityGroup(9)
         +--snmpObsoleteGroup(10)
         +--snmpWarmStartNotificationGroup(11)
         +--snmpNotificationGroup(12)

http://www.net-snmp.org/wiki/index.php/TUT:Writing_a_MIB_Module

nftw command line version

2008-12-13T09:32:00.002+03:00

POSIX C function nftw(p) walks directory tree and reports data on files.

Its just do something like piping of output of following line:

find  | xargs stat

Below is 100+ lines C++ version of previous line.


g++ exnftw.cpp -o nftw
------------%<---------------
#include <ftw.h>
#include <stdio.h>
#include <map>
#include <string>

/* 2008, Author: R.Gritsulyak 
 * public domain; 
 * g++ exnftw.cpp -o nftw
 * no warranty for this utility. 
 * patch sendto: roman.gritsulyak@gmail.com
 *
 * example for:
 int nftw(const char *path, int (*fn)(const char *,
 const struct stat *, int, struct FTW *), int depth, int flags);
*/

int fnfn(const char *path, const struct stat *ptr,int type, struct FTW *pft)
{
 const char *sflag;
 switch (type)
 {
  case FTW_NS:
   sflag="FTW_NS: no permission: exit by error;";
   break;
  case FTW_DNR:
   sflag="FTW_DNR: can not read dir; no further reads in;";
   break;
  case FTW_SLN:
   sflag="FTW_SLN: symbolic link on unknown path;";
   break;
  case FTW_SL:
   sflag="FTW_SL: should detect if only FTW_SL set;";
   break;
  case FTW_DP:
   sflag="FTW_DP: directory; we have been in subdirs;";
   break;
  case FTW_D:
   sflag="FTW_D: directory;";
   break;
  case FTW_F:
   sflag="FTW_F: file;";
   break;
  default: 
   sflag="unknown:";
 }

 printf("path=%s\ntype=%s\n",path,sflag);
 printf("stat.st_ino=%d\n",ptr->st_ino);
        printf("stat.st_mode=%o\n",ptr->st_mode);
        printf("stat.st_nlink=%d\n",ptr->st_nlink);
        printf("stat.st_uid=0%o\n",ptr->st_dev);
        printf("stat.st_gid=0%o\n",ptr->st_gid);
        printf("stat.st_rdev=%d\n",ptr->st_rdev);
        printf("stat.st_size=%d\n",ptr->st_size);
        printf("stat.st_blksize=%u\n",ptr->st_blksize);
        printf("stat.st_blocks=%u\n",ptr->st_blocks);
        printf("stat.st_atime=%d\n",ptr->st_atime);
        printf("stat.st_mtime=%d\n",ptr->st_mtime);
        printf("stat.st_ctime=%d\n",ptr->st_ctime);
  printf("FTW.base=%d\nFTW.level=%d\n",pft->base,pft->level); 
 return 0;
}


struct chvali
{
std::string ch;
int vali;
}; 

const int FLAGS=4;

chvali stra[] = {
{"FTW_CHDIR",FTW_CHDIR},
{"FTW_DEPTH",FTW_DEPTH},
{"FTW_MOUNT",FTW_MOUNT},
{"FTW_PHYS",FTW_PHYS}
}; 

int usage()
{
 fprintf(stderr,"Usage: nftw FLAG1 FLAG2 .. FLAGn depth path\n");
 fprintf(stderr,"FLAGx is FTW_CHDIR, FTW_DEPTH, FTW_MOUNT, FTW_PHYS\n");
 fprintf(stderr,"depth # number of file descriptors to use\n");
 fprintf(stderr,"man p nftw # for further details on args\n"); 
 return 0;
} 

int main(int argc, char ** argv)
{
 char * inipath; 
 int i;
 int idepth;
 int iflags;
 int curflag;

 std::map<std::string,int> chv;

 for(i=0;i<FLAGS;i++)
  chv[stra[i].ch]=stra[i].vali;  

 if (argc < 3)
 {
  exit(1);
 }

 iflags = 0;
 std::map<std::string,int> iter;

 for(i=1; i<argc-2; i++)
 {
     if( chv.find(argv[i]) != chv.end() )
  iflags = iflags | chv[argv[i]];   
            else
  {
  fprintf(stderr, "Wrong argument type:%s\n",argv[i]);
  usage();
  exit(-1);
  }
 }

 inipath = argv[argc-1];
 char *dum;
 idepth = strtol(argv[argc-2], &dum, 0);
  
 if(nftw(inipath,fnfn,idepth,iflags) != 0)
 {
  perror("nftw");
  exit(2);
 }

 exit(0);
}

related ftw example

When minimalism is bad

2008-12-11T08:58:00.006+03:00

I like Unix's for Unix's philosophy of building utilities, each of them makes just one job, but does this job perfectly.

This perfect minimalism make you extremely powerful in solving complex tasks with minimal effort.

However, I found myself completely frustrated by minimalism of some Unix's GUI applications.

For example Orage, XFCE organizer doesn't have feature of displaying full list of items (events, todo's journaled items).

There is search field there, but you can not search by glob or regexp :)

Normally, empty field should mean "display all", but not "display nothing".

Long "which" command form

2008-12-07T22:45:00.002+03:00

To display not only where is location of which argument,
but also attributes, and if it is symlink, on what binary this symlink points.

example of usage:


rtg@kubic-roman:~$ lwhich mine
error:no such
rtg@kubic-roman:~$ lwhich which
lrwxrwxrwx 1 root root 10 2008-05-01 01:30 /usr/bin/which -> /bin/which
rtg@kubic-roman:~$ lwhich nawk
lrwxrwxrwx 1 root root 22 2007-10-20 04:33 /usr/bin/nawk -> /etc/alternatives/nawk
rtg@kubic-roman:~$ ls -la /etc/alternatives/nawk
lrwxrwxrwx 1 root root 13 2008-05-01 16:49 /etc/alternatives/nawk -> /usr/bin/gawk

To use:
add in your .bashrc :


function lwhich
{
awhich=`which $1`
if [ "a$awhich" != "a" ] # or just if [ $awhich ]
then
ls -l $awhich
else
echo "error:no such"
fi
}

(re)start bash shell.

My Ubuntu installation config variables:

2008-12-07T22:32:00.003+03:00

Linux kubic-roman 2.6.24-22-generic #1 SMP Mon Nov 24 18:32:42 UTC 2008 i686 GNU/Linux

generated by APUE2 book chapter 2 program:

opt.txt


_POSIX_ADVISORY_INFO is defined (val is 200112)
sysconf says _POSIX_ADVISORY_INFO = 200112

_POSIX_ASYNCHRONOUS_IO is defined (val is 200112)
sysconf says _POSIX_ASYNCHRONOUS_IO = 200112

_POSIX_BARRIERS is defined (val is 200112)
sysconf says _POSIX_BARRIERS = 200112

_POSIX_CPUTIME is defined (val is 0)
sysconf says _POSIX_CPUTIME = 200112

_POSIX_CLOCK_SELECTION is defined (val is 200112)
sysconf says _POSIX_CLOCK_SELECTION = 200112

_POSIX_FSYNC is defined (val is 200112)
sysconf says _POSIX_FSYNC = 200112

_POSIX_IPV6 is defined (val is 200112)
sysconf says _POSIX_IPV6 = 200112

_POSIX_MAPPED_FILES is defined (val is 200112)
sysconf says _POSIX_MAPPED_FILES = 200112

_POSIX_MEMLOCK is defined (val is 200112)
sysconf says _POSIX_MEMLOCK = 200112

_POSIX_MEMLOCK_RANGE is defined (val is 200112)
sysconf says _POSIX_MEMLOCK_RANGE = 200112

_POSIX_MONOTONIC_CLOCK is defined (val is 0)
sysconf says _POSIX_MONOTONIC_CLOCK = 200112

_POSIX_MEMORY_PROTECTION is defined (val is 200112)
sysconf says _POSIX_MEMORY_PROTECTION = 200112

_POSIX_MESSAGE_PASSING is defined (val is 200112)
sysconf says _POSIX_MESSAGE_PASSING = 200112

_POSIX_PRIORITIZED_IO is defined (val is 200112)                              
sysconf says _POSIX_PRIORITIZED_IO = 200112

_POSIX_PRIORITIZED_SCHEDULING is undefined
no symbol for _POSIX_PRIORITIZED_SCHEDULING

_POSIX_RAW_SOCKETS is defined (val is 200112)
sysconf says _POSIX_RAW_SOCKETS = 200112

_POSIX_REALTIME_SIGNALS is defined (val is 200112)
sysconf says _POSIX_REALTIME_SIGNALS = 200112

_POSIX_SEMAPHORES is defined (val is 200112)
sysconf says _POSIX_SEMAPHORES = 200112

_POSIX_SHARED_MEMORY_OBJECTS is defined (val is 200112)
sysconf says _POSIX_SHARED_MEMORY_OBJECTS = 200112

_POSIX_SYNCHRONIZED_IO is defined (val is 200112)
sysconf says _POSIX_SYNCHRONIZED_IO = 200112

_POSIX_SPIN_LOCKS is defined (val is 200112)
sysconf says _POSIX_SPIN_LOCKS = 200112

_POSIX_SPAWN is defined (val is 200112)
sysconf says _POSIX_SPAWN = 200112

_POSIX_SPORADIC_SERVER is defined (val is -1)
sysconf says _POSIX_SPORADIC_SERVER = (no limit)

_POSIX_THREAD_CPUTIME is defined (val is 0)
sysconf says _POSIX_THREAD_CPUTIME = 200112

_POSIX_TRACE_EVENT_FILTER is defined (val is -1)
sysconf says _POSIX_TRACE_EVENT_FILTER = (no limit)
                                                                              
_POSIX_TIMEOUTS is defined (val is 200112)
sysconf says _POSIX_TIMEOUTS = 200112

_POSIX_TIMERS is defined (val is 200112)
sysconf says _POSIX_TIMERS = 200112

_POSIX_THREAD_PRIO_INHERIT is defined (val is 200112)
sysconf says _POSIX_THREAD_PRIO_INHERIT = 200112

_POSIX_THREAD_PRIO_PROTECT is defined (val is 200112)
sysconf says _POSIX_THREAD_PRIO_PROTECT = 200112

_POSIX_THREAD_PRIORITY_SCHEDULING is defined (val is 200112)
sysconf says _POSIX_THREAD_PRIORITY_SCHEDULING = 200112

_POSIX_TRACE is defined (val is -1)
sysconf says _POSIX_TRACE = (no limit)

_POSIX_TRACE_INHERIT is defined (val is -1)
sysconf says _POSIX_TRACE_INHERIT = (no limit)

_POSIX_TRACE_LOG is defined (val is -1)
sysconf says _POSIX_TRACE_LOG = (no limit)

_POSIX_THREAD_ATTR_STACKADDR is defined (val is 200112)
sysconf says _POSIX_THREAD_ATTR_STACKADDR = 200112

_POSIX_THREAD_SAFE_FUNCTIONS is defined (val is 200112)
sysconf says _POSIX_THREAD_SAFE_FUNCTIONS = 200112

_POSIX_THREAD_PROCESS_SHARED is defined (val is 200112)
sysconf says _POSIX_THREAD_PROCESS_SHARED = 200112

_POSIX_THREAD_SPORADIC_SERVER is defined (val is -1)
sysconf says _POSIX_THREAD_SPORADIC_SERVER = (no limit)

_POSIX_THREAD_ATTR_STACKSIZE is defined (val is 200112)
sysconf says _POSIX_THREAD_ATTR_STACKSIZE = 200112                            

_POSIX_THREADS is defined (val is 200112)
sysconf says _POSIX_THREADS = 200112

_POSIX_TYPED_MEMORY_OBJECTS is defined (val is -1)
sysconf says _POSIX_TYPED_MEMORY_OBJECTS = (no limit)

_XOPEN_UNIX is defined (val is 1)
sysconf says _XOPEN_UNIX = 1

_XOPEN_STREAMS is undefined
no symbol for _XOPEN_STREAMS

_XOPEN_CRYPT is defined (val is 1)
sysconf says _XOPEN_CRYPT = 1

_XOPEN_LEGACY is defined (val is 1)
sysconf says _XOPEN_LEGACY = 1

_XOPEN_REALTIME is defined (val is 1)
sysconf says _XOPEN_REALTIME = 1

_XOPEN_REALTIME_THREADS is defined (val is 1)
sysconf says _XOPEN_REALTIME_THREADS = 1

_POSIX_JOB_CONTROL is defined (val is 1)
sysconf says _POSIX_JOB_CONTROL = 1

_POSIX_READER_WRITER_LOCKS is defined (val is 200112)
sysconf says _POSIX_READER_WRITER_LOCKS = 200112

_POSIX_REGEXP is defined (val is 1)
sysconf says _POSIX_REGEXP = 1

_POSIX_SAVED_IDS is defined (val is 1)
sysconf says _POSIX_SAVED_IDS = 1

_POSIX_SHELL is defined (val is 1)
sysconf says _POSIX_SHELL = 1

_XOPEN_ENH_I18N is defined (val is 1)                                         
sysconf says _XOPEN_ENH_I18N = 1

_XOPEN_SHM is defined (val is 1)
sysconf says _XOPEN_SHM = 1

_POSIX_VERSION is defined (val is 200112)
sysconf says _POSIX_VERSION = 200112

_XOPEN_VERSION is defined (val is 600)
sysconf says _XOPEN_VERSION = 600

_POSIX_CHOWN_RESTRICTED is defined (val is 1)
pathconf says _POSIX_CHOWN_RESTRICTED = 1

_POSIX_NO_TRUNC is defined (val is 1)
pathconf says _POSIX_NO_TRUNC = 1

_POSIX_VDISABLE is defined (val is 0)
pathconf says _POSIX_VDISABLE = 0

POSIX_ASYNC_IO is undefined
pathconf says POSIX_ASYNC_IO = (no limit)

POSIX_PRIO_IO is undefined
pathconf says POSIX_PRIO_IO = (no limit)

POSIX_SYNC_IO is undefined
pathconf says POSIX_SYNC_IO = (no limit)
----%<----
ARG_MAX defined to be 131072
ARG_MAX = 131072
no symbol for ATEXIT_MAX
ATEXIT_MAX = 2147483647
CHARCLASS_NAME_MAX defined to be 2048
CHARCLASS_NAME_MAX = 2048
no symbol for CHILD_MAX
CHILD_MAX = 8125
no symbol for CLOCKTICKSPERSECOND /*clock ticks/second*/                      
CLOCKTICKSPERSECOND /*clock ticks/second*/ = 100
COLL_WEIGHTS_MAX defined to be 255
COLL_WEIGHTS_MAX = 255
HOST_NAME_MAX defined to be 64
HOST_NAME_MAX = 64
IOV_MAX defined to be 1024
IOV_MAX = 1024
LINE_MAX defined to be 2048
LINE_MAX = 2048
LOGIN_NAME_MAX defined to be 256
LOGIN_NAME_MAX = 256
NGROUPS_MAX defined to be 65536
NGROUPS_MAX = 65536
no symbol for OPEN_MAX
OPEN_MAX = 1024
no symbol for PAGESIZE
PAGESIZE = 4096
no symbol for PAGE_SIZE
PAGE_SIZE = 4096
RE_DUP_MAX defined to be 32767
RE_DUP_MAX = 32767
no symbol for STREAM_MAX
STREAM_MAX = 16
no symbol for SYMLOOP_MAX
SYMLOOP_MAX = (no limit)
TTY_NAME_MAX defined to be 32
TTY_NAME_MAX = 32
no symbol for TZNAME_MAX
TZNAME_MAX = 6
MAX_CANON defined to be 255
MAX_CANON = 255
MAX_INPUT defined to be 255
MAX_INPUT = 255
no symbol for FILESIZEBITS
FILESIZEBITS = 64
no symbol for LINK_MAX
LINK_MAX = 32000
NAME_MAX defined to be 255                                                    
NAME_MAX = 255
PATH_MAX defined to be 4096
PATH_MAX = 4096
PIPE_BUF defined to be 4096
PIPE_BUF = 4096
no symbol for SYMLINK_MAX
SYMLINK_MAX = (no limit)

SNMP monitoring resources list.

2008-12-07T19:53:00.002+03:00

SNMP:
http://net-snmp.sourceforge.net/wiki/index.php/Tutorials
Monitoring tools:
http://oss.oetiker.ch/mrtg/
http://www.cacti.net/
http://www.zenoss.com/

Freebsd 7.0 install on home box failed :(

2008-12-07T19:19:00.006+03:00

Found PS/2 keyboard to install Freebsd 7.0 on home AMD64 box.
Got just a reboot after 15 seconds.

Seems FreeBSD still doesn't like my hardware :(

Got funny messages about Giant Lock's and [panic] ohci_add_done.

Rebooted in CentOs.

Different signal handling under FreeBSD and Linux

2008-12-02T09:02:00.004+03:00

Signals Delivery and SA_RESTART:

Under 2.6 i386 Linux at home I have got all of this signals.

Under amd64 FreeBSD I have got only some of them.

That way under FreeBSD there are no warranty on signals delivery.


#include <stdio.h>
#include <signal.h>
#include <unistd.h>
#include <sys/types.h>
#include <sys/wait.h>
#include <stdlib.h>
#include <semaphore.h>

const int MAX_CHI=1000;

volatile int chld_count;

sem_t asem;

void handler(int sig)
{
  pid_t pid;
  sem_wait(&asem);
  chld_count ++;
  pid = wait(NULL);

  printf("Pid %d exited. count: %d\n", pid, chld_count);
  sem_post(&asem);
}

int main(void)
{ 
  int i;
  chld_count=0;
  struct sigaction sa;
  sem_init(&asem,0,1);

  signal(SIGCHLD, handler);

  sigemptyset(&sa.sa_mask);
  sa.sa_flags = SA_RESTART;
  sa.sa_handler = handler;
  
  sigaction(SIGCHLD, &sa, NULL);

  for(i=0;i<MAX_CHI;i++)
  {
   int ret_val;
   ret_val=fork();

   if(ret_val==-1)
   {
    perror("fork()"); 
   }
   else if(!ret_val)
   {
    printf("in child;Child pid is %d\n", getpid());
      exit(0);
   }
   else
   {
    printf("Parent pid is %d; child is %d;\n", 
      getpid(),ret_val);
   }
  }

  for(i=0;i<MAX_CHI;i++)
 {
 int wparam;
 wait(&wparam); 
 }

  return 0;
}

ftw example for systems comparison.

2008-11-30T14:00:00.007+03:00

ftw(3) has some inconsistencies.

For example ftw don't call its processing function for symlinks pointed from starting directory to starting directory, or its subdirs.

However, link to parent dir from starting directory reported in further walk.

From the other side, ftw checks and doesn't segfault in looping symlinks.

Checked under Linux 2.6.

source of example:

#include <ftw.h>
#include <stdio.h>
/*
* example for
* int ftw(const char *path, int (*fn)(const char *,
* const struct stat *ptr, int flag, int ndirs);
*/

int ffn(const char *path, const struct stat *ptr, int flag)
{
printf("Found\n path:%s\nflag%d\n", path, flag);
return 0;
}

int main(int argc, char ** argv)
{
char * inipath;
// example:
if (argv[1] && *argv[1])
{
inipath = argv[1];
}
else
{
fprintf(stderr,"usage: exftw PATH\n");
exit(-1);
}

if(ftw(inipath,ffn,20) != 0)
{
perror("ftw");exit(2);
}

return 0;
}

note: on my system it processed homedir with links for one minute.
when i have removed output by printf in ffn function from code, the time was just 1 second;

It looks like it is fast enough in comparison with output.

to check previous statement:

gcc exftw.c -o exftw
ln -s . dirlnsym
./exftw
./exftw | grep dirlnsym
# no reported dirlnsym reported
rm dirlnsym
ln -s ../../ dirlnsym
./exftw | grep dirlnsym
# ok; all reported and no looping

bookmarks on books been read in different time and steel having value:

2008-11-26T23:51:00.008+03:00

http://samizdat.mines.edu/howto/HowToBeAProgrammer.html?p=1#id2854043: How to be a programmer. good and short.

http://www.yendor.com/programming/unix/apue/apue.html - classical book by Stevens. Very good one.

http://www.advancedlinuxprogramming.com/ not such a good as AUP book by Stevens, but worth to see.

http://www.cs.fsu.edu/~xyuan/cop5570/ - another advanced source, .ppt with examples.

http://catb.org/~esr/writings/taoup/html/ Art of unix programming - very good for understanding architectural principles of Unixes.

http://www.khmere.com/freebsd_book/index.html

HOT:
http://www.tldp.org/HOWTO/Linux+FreeBSD.html

Signal delivery failed under FreeBSD.

2008-11-25T22:41:00.006+03:00

Some unexpected staff from system well known for stability:
http://www.freebsd.org/cgi/query-pr.cgi?pr=129172

Strange, thу code cited under the link works fine under (Ubuntu 8.04) GNU/Linux.

freebsd biord in top

2008-11-24T23:32:00.005+03:00

It is state, like deadlock, when kernel is waiting for disk.
wdrain is like this.

These both are undocumented states of kernel.

If you catched biord or wdrain (or ffsfsn, or some other strange status (that is not kserel, CPU, select or other statuses normally displayed in top), most probably you have serious problems with i/o of your application.

Planning

2008-11-24T23:18:00.004+03:00

Simple Plan of Plan:
1) get all tasks.
2) get all dependencies.
3) estimate 'strength' of dependencies.
4) estimate 'value' and 'price' of tasks by different dimensions
5) make sequence of tasks.
6) put time on chart to produce schedule and Gantt Chart.

Last 3 monthes events

2008-11-24T23:07:00.003+03:00

FreeBSD 6.3 installed and configured (and reconfigured a lot of times).
Very different from stable production one's.

ipfw, pf, and semaphores are in separate kernel modules that is strange.
Very different administration utilities from Linux.

However, it is much more friendly to developer than AIX (if do not consider commercial tools).

Mysql actively used. Moved completely to open-source tools.

Moved to group work ( from stand-slone mode ).

SVN commands + vim

2008-11-13T23:16:00.009+03:00

in .bashrc:

function svnvim
{
# 9 params will be enogh
svn $1 $2 $3 $4 $5 $6 $7 $8 $9 > /tmp/svnvim.$1 ; vim /tmp/svnvim.$1
}

example of usage:

svnvim diff [param]
then is colourized
(if colours are set in vim).

another usage:
svnvim log
svnvim info
svnvim stat

(just remembered vi command inside sybase isql :) )

simple malloc test for systems comparison

2008-10-19T20:52:00.002+04:00

#include <stdlib.h>
#include <stdio.h>
#include <errno.h>
static int *intarr;
static const int iMax = 200000;
static const int iiMax = 500000;
int main()
{
int i;
for(i=0; i<iiMax; i++)
{
intarr = (int *) malloc(sizeof(int)*iMax);
if (errno)
{
perror(sys_errlist[errno]);
break;
}
else
printf("ok\n");
}
char c;
printf("%d",i*iMax);
scanf("%c",&c);
return 0;
}

output of top on centos:


top - 20:53:09 up 2 days, 22:52,  9 users,  load average: 2.74, 1.13, 0.77
Tasks: 168 total,   1 running, 167 sleeping,   0 stopped,   0 zombie
Cpu(s):  3.6%us,  1.7%sy,  0.0%ni, 94.2%id,  0.3%wa,  0.2%hi,  0.0%si,  0.0%st

PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                   
28315 rtg       16   0  290g 999m  596 S    0 53.1   0:06.64 my_tst                     
4296 rtg       15   0  451m 5268 2360 S    0  0.3   0:20.46 nautilus

Just a little summary of tags in the head

2008-10-12T22:55:00.006+04:00

Programming:
- different threading models
- Scheduling policies
- differences of Unixes
- Testing
- Synchronizing problems
- Databases
- File systems
- speed of programming
- problem statements
- Architecture

Company
- globalization
- organization

Life
- Human factor
- sleep
- Relaxation
- Stress
- coffee
- language
- communication
- need for more personal time
- health care
- medicine
- organizers

eee pc ubuntu psx (playstation emulator)

2008-10-04T04:04:00.003+04:00

get and unpack psx
from there:

http://psxemulator.gazaxian.com/

find and install bios (get from your device)

install lib:

sudo apt-get install libgtkglext1

cd pSX
./pSX

eee pc ubuntu zsnes with sound

2008-10-04T03:35:00.003+04:00

start it.

# zsnes -ad sdl {romfile}

build autotools project with gcov support

2008-09-29T01:33:00.004+04:00

usage:


./configure  CFLAGS='-fprofile-arcs -ftest-coverage'
./configure CFLAGS='-fprofile-arcs -ftest-coverage' CXXFLAGS='-fprofile-arcs -ftest-coverage'

cd src
./
gcov 
vim 
...
        -:   25:
        1:   26:if (argv[1][0]=='-') {
    #####:   27:std::cout << "options not supported yet;" << std::endl;
    #####:   28:exit(1);
        -:   29:}
        -:   30:
...

'#####' lines there indicate dead code in this run;
ciphers indicate number of times this peace of code was run.

Using autotools HOWTO

2008-09-28T23:47:00.004+04:00

Following is autotools buildsystem example/introduction that can be used to create build system that:

- creates libraries
- creates binaries
- creates tests
- executes tests

It is intended for C/C++ project.

Following directory structure used:


project/ +-- reconfig.sh
         +-- configure.ac
         +-- Makefile.am
         +-- src  +
             tests+
             lib/libname/

project/reconfig.sh :



#!/bin/sh
# after editing configure.ac and|or Makefile.am
aclocal
autoheader
autoconf
automake -a
./configure

project/Automake.am :



SUBDIRS = lib/libname src tests  

project_pre = 1.0

project/configure.ac :




AC_PREREQ(2.59)

AC_INIT(src/project.h)

AM_INIT_AUTOMAKE(project,1.0)

AC_CONFIG_HEADER([config.h])

# Checks for programs.
AC_PROG_CXX
AC_PROG_CC

# Checks for libraries.
AC_PROG_RANLIB
# Checks for header files.

# Checks for typedefs, structures, and compiler characteristics.
AC_C_CONST

# Checks for library functions.
AC_HEADER_STDC
AC_CHECK_FUNCS([memset])

AC_OUTPUT([Makefile src/Makefile
           lib/libname/Makefile
           tests/Makefile])

project/src/Makefile.am



bin_PROGRAMS = project
clones_SOURCES = main.cpp 

clones_LDADD = ../lib/libname/libname.a

#clones_LIBADD = ../lib/libname/libname.a

AM_CPPFLAGS = -I$(top_srcdir)/lib/libname/ -I$(top_builddir)/lib/libname/

project/src/libname/Makefile.am:



noinst_LIBRARIES = libname.a
libname_a_SOURCES = libname.c

project/tests/Makefile.am:



bin_PROGRAMS = libname_test test_test
libname_test_SOURCES = libname_test.c
test_test_SOURCES = test_test.c

critbit_test_LDADD = ../lib/libname/libname.a

check_PROGRAMS = libname_test test_test

TESTS = $(check_PROGRAMS)

AM_CPPFLAGS = -I$(top_srcdir)/lib/libname/ -I$(top_builddir)/lib/libname/

To try this example:

- create directory structure;
- create .sh , .in and .ac files described above
- Create .c files with names defined in .am files above in corresponding dirs.

reconfig.sh should create makefiles that could be used.

make - creates binaries
make check - performs tests

another introduction could be found there:
http://www.gnu.org/software/automake/manual/html_node/Creating-amhello.html#Creating-amhello

EPEL repository for CentOS 5

2008-09-21T21:34:00.007+04:00

To make your x64 CentOS more Desktop-friendly
create file "/etc/yum.repos.d/EPEL.repo"

with contest:

[epel]
name=Epel from fedora
baseurl=http://download.fedora.redhat.com/pub/epel/5/x86_64/
gpgcheck=0

From now it is possible to install such applications,that are not available in original CentOS installation,
as Wine,DosBox, fbreader, gnochm, gnokii, gparted, kdiff3, octave and so on.

Priorities plugin for yum should be enabled for that.

MySql basics CentOs 5

2008-09-17T22:52:00.005+04:00

# mysql --version
mysql Ver 14.12 Distrib 5.0.45, for redhat-linux-gnu (x86_64) using readline 5.0

# mysql
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.soc
k' (2)

to resolve :

# sudo mysql_install_db --user=mysql

Set password:

/usr/bin/mysqladmin -u root password 'new-password'

start engine:

# sudo /usr/bin/mysqld_safe &

Starting mysqld daemon with databases from /var/lib/mysql

# ps -efa| grep mysql
root 20687 4414 0 23:19 pts/2 00:00:00 /bin/sh /usr/bin/mysqld_safe
mysql 20730 20687 0 23:19 pts/2 00:00:00 /usr/libexec/mysqld --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file=/var/run/mysqld/mysqld.pid --skip-external-locking --socket=/var/lib/mysql/mysql.sock
rtg 20749 4414 0 23:19 pts/2 00:00:00 grep mysql

change password:

# sudo /usr/bin/mysqladmin -u root password 'NEWpassword'

login and issue some commands:

# mysql -u root -p
Enter password:
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 6
Server version: 5.0.45 Source distribution

Type 'help;' or '\h' for help. Type '\c' to clear the buffer.

mysql>
mysql> show databases
-> ;
+--------------------+
| Database |
+--------------------+
| information_schema |
| mysql |
| test |
+--------------------+
3 rows in set (0.00 sec)

mysql> help contents
You asked for help about help category: "Contents"
For more information, type 'help ', where is one of the following
categories:
Account Management
Administration
Data Definition
Data Manipulation
Data Types
Functions
Functions and Modifiers for Use with GROUP BY
Geographic Features
Language Structure
Storage Engines
Stored Routines
Table Maintenance
Transactions
Triggers

Create user:

mysql> CREATE USER rtg identified by 'password'
-> ;
Query OK, 0 rows affected (0.00 sec)

mysql> quit
Bye
[rtg@rtgCent usr]$ mysql -u rtg -p
Enter password:
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 9
Server version: 5.0.45 Source distribution

Type 'help;' or '\h' for help. Type '\c' to clear the buffer.

mysql>

Minix3 book version under qemu

2008-08-15T00:27:00.000+04:00

# prepare for running image from qemu

cd work
bunzip2 minix-3.1.0-book.iso.bz2
sudo mkdir /mnt/minix3
sudo mount -t iso9660 -o loop minix-3.1.0-book.iso /mnt/minix3

mkdir minix
cd minix
qemu-img create minix3.img 2048M

# we are in the work/minix ; iso is in up directory

qemu -boot a -fda /mnt/minix3/bootflop.img -hda "minix3.img" -cdrom ../minix-3.1.0-book.iso -m 64 -localtime

to install with network better proceed with manual:
http://wiki.minix3.org/wikis/minix3/Running_MINIX_3_on_Qemu

Databases; central table

2008-08-14T01:36:00.007+04:00

Found that basically specialized database could be presented as the central table, with other tables as just supporting infrastructure for central one.

To found central table in you application just grep | wc source code in loop by all tables names presented in your database.

It is easier than counting statistics on links in local hypertext.

Cygwin pthreads exit causes access violation example

2008-08-14T01:13:00.006+04:00

Example of stack overflow in cygwin.

While researched linking and AIX portability, tried example from there:
http://www.ibm.com/developerworks/aix/library/au-gnu.html?S_TACT=105AGX99&S_CMP=CP
(it is erroneous; simple mistakes were fixed):

After exit on cygwin it warns with access violation.

Executable than blocked (for removal).

ddd installation on centOS

2008-07-27T23:59:00.004+04:00

get ddd there:

http://ftp.gnu.org/gnu/ddd/

Through yum, install following package:


RPM Group    : Development/Libraries
Source       : openmotif-2.3.0-0.5.el5.src.rpm
Yum Group    : Development/X Software Development
 -> Type     : Optional
Build Time   : Sun May 25 06:14:11 2008
Install Time : Sun Jul 27 23:56:16 2008
License      : Open Group Public License

and it dependencies

then

tar -xf ddd-.tar.gz
cd ddd
./configure
make
sudo make install

Gcc auto-vectorization

2008-07-22T00:31:00.005+04:00

Code: vect_auto.c

#include <stdio.h>
#include <string.h>

int main()
{
int i,j,k,l;

int a[4096];
int b[4096];

memset((void *)a,0,4096);
memset((void *)b,0,4096);

for(i=0;i<4096;i++)
{
a[i] =i%67;
b[i]= i%87;
}

for(k=0;k<200000;k++)
for(i=0;i<4096;i++)
a[i] = a[i]+b[i];

l=0;

for(j=0;j<4096;j++)
{l=l+a[i];}

// printf("%d\n",l);
return l;
}


$ gcc -O3 -ftree-vectorize vect_auto.c -o vect_o

disasm:


0x0000000000400530 :  movdqa (%rax,%rbp,1),%xmm0
0x0000000000400535 :  paddd  (%rax,%rbx,1),%xmm0
0x000000000040053a :  movdqa %xmm0,(%rax,%rbx,1)
0x000000000040053f :  add    $0x10,%rax
0x0000000000400543 :  cmp    $0x4000,%rax
0x0000000000400549 :  jne    0x400530


$ gcc -O3 vect_auto.c -o vect_o_no
disasm:

0x0000000000400528 :  xor    %edx,%edx
0x000000000040052a :  nopw   0x0(%rax,%rax,1)
0x0000000000400530 :  mov    0x0(%rbp,%rdx,4),%eax
0x0000000000400534 :  add    %eax,(%rbx,%rdx,4)
0x0000000000400537 :  add    $0x1,%rdx
0x000000000040053b :  cmp    $0x1000,%rdx
0x0000000000400542 :  jne    0x400530 
0x0000000000400544 :  add    $0x1,%ecx 
0x0000000000400547 :  cmp    $0x30d40,%ecx
0x000000000040054d :  jne    0x400528

[rtg@rtgCent vect]$ time ./vect_o_no

real 0m2.178s
user 0m2.128s
sys 0m0.003s
[rtg@rtgCent vect]$ time ./vect_o

real 0m0.867s
user 0m0.835s
sys 0m0.001s

vector operations used in the second executable, but gain in time is not such a big.

CPP (C++) vs C, std::string vs char[] : string processing benchmark

2008-07-15T23:25:00.002+04:00

Very simple benchmark.
cpp source vs c source

This presents usage of string concatenation operators in c and c++.

C is up to 20 times faster on different compilers on small strings.
(However it just 3 times faster on my CentOS if outer loop increased up to 10000)


[rtg@rtgCent cpp_vs_c]$ g++ -O3 ppstr.cpp -o ppstr
[rtg@rtgCent cpp_vs_c]$ gcc -O3 cstr.c -o cstr
[rtg@rtgCent cpp_vs_c]$ sudo time nice -n -10 ./ppstr
[rtg@rtgCent cpp_vs_c]$ sudo time nice -n -10 ./cstr

(or xlC instead of g++ and gcc if you have IBM compiler)

Eject cd or DVD disk under Linux

2008-07-12T00:47:00.005+04:00

If you are not able to eject cd (or DVD) disk from your linux box (by pushing button on cd(DVD)-rom)/ try


umount /dev/cdrom-hda

instead of cdrom-hda another name for the cd device can be.

This will solve issue.

stupid vs smart, case vs ftable, algorithms vs processors, testing price vs gain

2008-07-10T23:00:00.010+04:00

Actually, the task below can be easily solved by the paper and pen.

It was written in home at evening, just to measure performance as additional argument for rewriting stupid code for improving maintainability and performance of old legacy code.

Hypothetical example of the optimization of the following code was considered, and the return of the optimization effort (as resulting 'optimized' code) was timed.

     for(unsigned int i=0;i<65536;i++)
        for(unsigned int j=0;j<65536;j++)
         switch(j%15+1)
                {
                case 1:
                f1();
                break;
                case 2:
                f2();
                ...
                }

The following are examples of performance, that can be achieved for integer massive operations due to different types of optimization.

Tried on AMD dual core DeskTop centOS, with gcc 4.1.3,
with optimization, and without.

4 types of code were considered:

Using switch(code) and case to define function to call;

Using case(code) and inlining function in call;

Using call to function by code ( fun(code) );

Just doing job without obfuscation by ftabs and cases.

Compilation done in following way:


[rtg@rtgCent cpp_exa]$ g++ -O3 case.cpp -o caseo
[rtg@rtgCent cpp_exa]$ g++ -O3 ftab.cpp -o ftabo
[rtg@rtgCent cpp_exa]$ g++ ftab.cpp -o ftab
[rtg@rtgCent cpp_exa]$ g++ case.cpp -o case
[rtg@rtgCent cpp_exa]$ su -

Some examples of output:

Red and green just presents timing for worst and best timing.


[root@rtgCent cpp_exa]# time nice -n -10 ./case
-458752

real    2m23.422s
user    2m23.205s
sys     0m0.112s

[root@rtgCent cpp_exa]# nice -n -10 ./caseo
-458752
[root@rtgCent cpp_exa]# time nice -n -10 ./caseo
-458752

real    1m3.688s
user    1m3.614s
sys     0m0.054s

[root@rtgCent cpp_exa]# time nice -n -10 ./ftab
-458752

real    1m41.664s
user    1m41.521s
sys     0m0.101s
[root@rtgCent cpp_exa]# time nice -n -10 ./ftabo 
-458752

real    0m56.068s
user    0m56.004s
sys     0m0.047s
[root@rtgCent cpp_exa]# time nice -n -10 ./plaino 
-458752

real    1m3.801s
user    1m3.732s
sys     0m0.047s

[root@rtgCent cpp_exa]# time nice -n -10 ./plain
-458752

real    1m53.174s
user    1m53.060s
sys     0m0.079s

[root@rtgCent cpp_exa]# time nice -n -10 ./opto 
-458752

real    0m14.527s
user    0m14.509s
sys     0m0.014s

[root@rtgCent cpp_exa]# time nice -n -10 ./opt
-458752

real    0m31.956s
user    0m31.923s
sys     0m0.022s

It were just examples of the simpliest 'non algorithmic' optimization.

Simplified 'Algorithmic' optimization of the simplest case gives more than 100 time's faster output:


[root@rtgCent cpp_exa]# time nice -n -10 ./alg
-458752

real    0m0.011s
user    0m0.004s
sys     0m0.005s
[root@rtgCent cpp_exa]# time nice -n -10 ./algo
-458752

real    0m0.011s
user    0m0.003s
sys     0m0.005s

If you have some different opinion/results, please report in comments :)

By the way, who needs optimization today of critical systems, with today's pricing on retesting of system, and today modern cheap fast processors?

Code for examples:
alg.cpp
ftab.cpp
case.cpp
plain.cpp
opt.cpp

cpuinfo:

cpuinfo

atexit() example. exit (1) in main, but $?=0

2008-07-09T00:31:00.005+04:00

This atexit function just look like another way to obfuscate programs.
Example:


[rtg@rtgCent cpp_exa]$ cat atex.c
#include <stdio.h>
#include <stdlib.h>

void mine(void)
{
printf("mine!\n");
exit(0);
}

void yours(void)
{
printf("yours!\n");
exit(1);
}

int main(int argc,char **argv )
{
 atexit(mine);
 atexit(yours);
 printf("exiting...\n");
 exit(1);
}
[rtg@rtgCent cpp_exa]$ gcc atex.c 
[rtg@rtgCent cpp_exa]$ ./a.out 
exiting...
yours!
mine!
[rtg@rtgCent cpp_exa]$ echo $?
0

c99 vectors, c++ example.

2008-07-08T02:07:00.003+04:00

C99 vectors example .c file.
vector's some, and way to view as int's (through union).

C++ references as class members (with initialization, that should be done ), static counter of objects, array, and copy constructor (have to be?) .cpp file.

Gentoo install from liveCD

2008-07-07T08:56:00.001+04:00

On Amd64 livecd of Gentoo install fails.

Just because it is not right way to install Gentoo.

No way except of install from minimal with emerge/ebuild procedure.

setjmp, longjmp second parameter

2008-07-03T00:40:00.006+04:00

setjmp, longjmp looks like continuations in functional languages.

This functions save/restore call contest as it does call/cc.

modified example from there:

http://publications.gbdirect.co.uk/c_book/chapter9/nonlocal_jumps.html

return values (second argument of longjmp example)


[rtg@rtgCent example]$ vi _jmp.c
[rtg@rtgCent example]$ gcc -g _jmp.c -o jmp
[rtg@rtgCent example]$ ./jmp 
inside jmp: func
place retval=1
inside jmp: func2
place 2 retval=32

despite of longjmp second parameter set to zero, retval displayed as 1.

Here is example wich shows global and local variables in caller contest change.
_jmp2.c

CentOS x64: firefox java and flash plugin

2008-06-22T19:05:00.018+04:00

Last solutions of problems with x64 that worked:

Flash:

just got it from there:
http://labs.adobe.com/downloads/flashplayer10.html

then in terminal:


$ tar -xf libflashplayer-10.0.22.87.linux-x86_64.so.tar.gz
$ sudo cp libflashplayer.so /usr/lib64/mozilla/plugins/

Restart firefox-64 bit;
Youtube is working. Google analytics is also working.

Below are the previous problem solutions that worked in different time

They are working from time to time. (see comments also for details).

Java:

Firefox requested for additional plugin and directed to java page for download. After that, downloaded 32-bit (not x64!) rpm of java from sun.

Warning: if following this guide check java versions,sun updates versions of java, so numbers could be different, and pathes,if such present in the command line.

chmod a+x jre-6u6-linux-i586-rpm.bin
./jre-6u6-linux-i586-rpm.bin

fix alternatives file. Set sun's:

[root@rtgCent Desktop]# /usr/sbin/alternatives --install /usr/bin/java java /usr/lib/jvm/jre-1.4.2-gcj/bin/java 1
[root@rtgCent Desktop]# /usr/sbin/alternatives --install /usr/bin/java java /usr/java/jre1.6.0_06/bin/java 2
[root@rtgCent Desktop]# /usr/sbin/alternatives --config java

There are 2 programs which provide 'java'.

Selection Command
-----------------------------------------------
1 /usr/lib/jvm/jre-1.4.2-gcj/bin/java
*+ 2 /usr/java/jre1.6.0_06/bin/java

Enter to keep the current selection[+], or type selection number:

# ln -s /usr/java/jre1.6.0_06/plugin/i386/ns7/libjavaplugin_oji.so /usr/lib/mozilla/plugins/libjavaplugin_oji.so

[root@rtgCent Desktop]# vi /etc/profile.d/java.sh
export J2RE_HOME=/usr/java/jre1.6.0_06
export PATH=$J2RE_HOME/bin:$PATH

save by :wq ; (or use gedit/mousepad/kate if don't like vi) restart firefox,

check,if all working.

Flash

Solution 1:

For CentOS 5.2 firefox 64-bit works better with nsplugnwrapper from the box.
Just reinstall nsplugiwrapper to resolve initial problem with flash that can be.
However java not worked and I moved to 32-bit version of firefox.
Procedure below is related to ff 1.5 and CentOS 5.1, but it works for firefox 3 under centos 5.2 also

Solution 2:

To fix various errors with java and flash under CentOS x64 on my AMD-based home box, I've tried to use nspluginwrapper, manually installed java 64-bit from sun, also various versions of flash from Adobe by downloading rpm and manual install.

Finally problem was not completely solved after that, some issues were with flash, and I haven't got java working.

To solve I just decided to move on 32-bit version.

That way I just stopped Firefox, issued following

su -
[insert pwd]
yum list installed firefox jre
yum remove jre.x86_64
yum remove firefox.x86_64
yum install firefox.i386

and I got flash working without problems on google analytics.

Installing eee Ubuntu 8.04

2008-06-21T00:57:00.004+04:00

After some tries get it successfully in following most simplest way.

get by torrent linked there:

http://www.ubuntu-eee.com/index.php5?title=Get_Ubuntu_Eee

Tweaked by Ricey tweak


wget http://eee.ricey.co.uk/files/eee/RiceeeyTweak.sh
chmod +x RiceeeyTweak.sh
./RiceeeyTweak.sh

It is working fine after reboot.

eeeXubuntu 7.10 update of the kernel to 22-15

2008-06-20T01:50:00.005+04:00

After update of kernel to 2.6.22-15 on Asus eeePC in eedXubuntu 7.10 wifi stopped working.
downloaded sources from sourceforge,


tar -xf madw*
cd mad*
sudo make all
sudo make install

hsven't got result; modprobe and other hints also are not working.
tried scripts from there -
http://code.google.com/p/eee-osd/downloads/list?can=1&q=&colspec=Filename+Summary+Uploaded+Size+DownloadCount
they are also not working.
now Just using previous version of the kernel to work with wifi.

Going to reinstall from scratch ubuntu 8.04

mc : can not ftp on ftp://xxx.xxx.xxx.xxx address

2008-06-17T10:37:00.001+04:00

To browse on ftp in mc :
F9->Left->ftp link

If you insert ip address with 'ftp://' prefix,
ftp can fail with error of bad access for anonymous.

Just insert ip without any prefixes and postfixes, and then browse.

Claws mail -> move mail (inbox and other folders) to card

2008-06-04T22:28:00.003+04:00

I am using Claws mail to read my gmail through on my eeeXubuntu on eee pc.

It is very compact and for me is better than ThunderBird.

When I created account by default, the mail client created folder named "gmail" in my home,
that uses a lot of space even with plain text formatted messages inside.

To resolve , I decided to move mail on sd card I have.

That way I just typed following three strings in bash shell,
and space on SSD disk was freed:


cd ~
mv gmail /media/disk/
ln -s /media/disk/gmail gmail

Just some ideas on freemind

2008-06-03T11:01:00.001+04:00

I have found freemind application very useful for planning my activities,
as ideas management tool, and as knowledge store.

However with time (1.5 years of continuous maps update) I started to experience lack of the functionality / external tools to better maps organization/analyses.

Most wanted for now:

- Extract history ( list of nodes in chronological order)
- Ability to search all maps linked from map where search started.
- Ability to share some parts of the map between different maps.
- Ability to load multiple linked maps in one screeen

Google docs

2008-06-03T08:00:00.002+04:00

Made a little presentation from one of my posts.

Move local CVS repository to RCS

2008-05-21T14:44:00.007+04:00

The following is the way to convert existing CVS repository to RCS.
Actually no conversion required;
It works for me; no warranty that it would work for somebody else;


# from /home/rtg/
mkdir for_rcs
cd for_rcs
# CVS_REPO/cvs:/ - is repository created with cervesia
cp -r /home/rtg/CVS_REPO/cvs\:/* .
find ./ -name CVS | xargs rm -rf
for i in `find ./ -type d` ; do cd $i ; mkdir RCS ; mv *,v RCS/ ; cd /home/rtg/for_rcs/ ; done

Ok, at this point I have RCS repository in for_rcs folder.
:)

KVM on core 2 duo laptop Ubuntu / Failed :(

2008-05-21T13:51:00.007+04:00

After successfull usage of KVM on my CentOS desktop,
started installation of kvm on Ubuntu (Xubuntu 8.04) on my Core2 duo laptop:


$ sudo apt-get install kvm
..
 * Your system does not have the CPU extensions 
required to use KVM. Not doing anything. 
# check for presence of vitualization in cpu
$ cat  /proc/cpuinfo
processor       : 0
vendor_id       : GenuineIntel
cpu family      : 6
model           : 15
model name      : Intel(R) Core(TM)2 Duo CPU     T5470  @ 1.60GHz
stepping        : 13
cpu MHz         : 800.000
cache size      : 2048 KB
physical id     : 0
siblings        : 2
core id         : 0
cpu cores       : 2
fdiv_bug        : no
hlt_bug         : no
f00f_bug        : no
coma_bug        : no
fpu             : yes
fpu_exception   : yes
cpuid level     : 10
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge 
mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm 
constant_tsc arch_perfmon pebs bts pni monitor ds_cpl est tm2 ssse3 cx16 
xtpr lahf_lm ida
bogomips        : 3195.76
clflush size    : 64

processor       : 1
vendor_id       : GenuineIntel
cpu family      : 6
model           : 15
model name      : Intel(R) Core(TM)2 Duo CPU     T5470  @ 1.60GHz
stepping        : 13
cpu MHz         : 800.000
cache size      : 2048 KB
physical id     : 0
siblings        : 2
core id         : 1
cpu cores       : 2
fdiv_bug        : no
hlt_bug         : no
f00f_bug        : no
coma_bug        : no
fpu             : yes
fpu_exception   : yes
cpuid level     : 10
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr 
pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm 
pbe nx lm constant_tsc arch_perfmon pebs bts pni monitor ds_cpl est 
tm2 ssse3 cx16 xtpr lahf_lm ida
bogomips        : 3191.86
clflush size    : 64
#is virtualization in flags?
$ egrep 'vmx|svm' /proc/cpuinfo 
$

Ups, failed :(

It was because KVM works only with specific processors.

To conclude: Different CPU model have different best virtual machine.

That way further I'll try Xen there
(which failed on my CentOS desktop due to lack of rtl8168/8111 drivers from the box;
It seems that if they will be installed, there is high probability of lacking
the driver after the updates of the xen kernel package).

Are there in this world any examples of successful usage of GPL in business?

2008-05-21T09:15:00.006+04:00

Do you know any examples of successful usage of GPL in business?
Seeking an example of building business on writing GPL software.

I have tried to google model for making money from open source.

There several models for making money from open source that is already written listened,
and some models for making money from writing open source software.

However it seems that it is easier to get money from existing open source than from your own (written by yourself).

There are methods to get money for developer in short, that were found.
(Actually it is very hard to get opinion of person who really makes money, however there are a lot of speculations from people who got from there work for community zero, just dreaming about money from open source. Following are just opinion of people involved in different discussions in Net).

1) Banners Advertisement.
Very simple - put ads on your web-site. Users who have no direct goal when visiting your site, that hosts the software. Very old and easy model. One issue: Why software than?
It seems that it is better to write about housekeeping and Britney new friend, and have much more stupid visitors that have no exact goal (to download your software in the case).

2) Support.
Write software, and somebody will pay you to describe how to work with it and keep it working on servers. Examples of companies : RedHat, JBoss. However, RedHat doesn't write software. RedHat just integrates modules in distro and provide support. Actually it sells risks, due to QoS statement.

JBoss was GPL project, and was bought by Sun. Actually I don't know who got money, and are all code contributors were payed.

MySQL and TrollTech examples, actually represent dual-licensing models (free for free development, and payed for commercial). This case is of:
3rd) Use free version as advertisement and as testing platform for your non-free version.

4) Develop free for one platform (actually testing), and got support from hardware vendors for another platforms. This is example of Linux kernel.

The tool and application you developing that way have actually to represent more value for hardware vendor than other open-source projects in queue for sharing budget of the vendor for such projects.

No warranty that your effort will be payed at all.

However, from my experience (and with my estimate), if you write something that was helpful for solving your tasks, and published it in user-friendly and easy to use form, it will be used by somebody else with 95% of probability. But they will pay you with 95% of probability nothing for your effort.

5) Develop proprietary software using existing LGPL, BSD, MIT code.
And again it is not about writing the open source, and just about reusing existing for making your own NON-GPL business.

I found no example in the real world were GPL license were better that some else (don't consider dual-licensing model, it has issues like mentioned under the link).

Virtualization with KVM

2008-05-19T17:49:00.006+04:00

Used this guide:
http://wiki.centos.org/HowTos/KVM to run virtual machine on my CentOS box.

Xubuntu run in 3-5 min's, that is 5-10 times faster than with native quemu virtualization from box.

For now I will use it as default virtual machine.

Tips for creation of new machine:


su
qemu-img create -f qcow2 disk.img 5G
qemu-kvm -hda disk.img -cdrom 
/media/Elements_/images/eeexubuntu-7.10.3/eeexubuntu-7.10.3-desktop-i386.iso 
-m 512 -boot d

CentOS 5.1 gparted

2008-05-19T16:25:00.002+04:00

Failed to run gparted installed through yum, in xfce environment.

[rtg@rtgCent ~]$ gparted

does nothing.

[root@rtgCent rtg]# which gparted
/usr/bin/gparted 
[root@rtgCent rtg]# updatedb
[root@rtgCent rtg]# locate gparted
/etc/pam.d/gparted
/etc/security/console.apps/gparted
/usr/bin/gparted
/usr/bin/run-gparted
/usr/sbin/gparted
...

found another item in /usr/sbin/ (that can be run as root)
And it is solution:

[rtg@rtgCent ~]$ su root
Password: 
[root@rtgCent rtg]# /usr/sbin/gparted

given me gparted window.

rcs + rsync for keeping your files on several machines

2008-05-19T09:44:00.005+04:00

I have two GNU/Linux laptops (Xubuntu) and one GNU/Linux desktop (CentOS).

Need to synchronize them to keep the integrity of the information on the machines.

Tried git, but found it too strong too keep my little docs and code snippets.
That way decided to use well known and stable GNU tools rcs and rsync.

man rcs 
man rsync

are prerequisites ;

Why rcs? Because repository could be synced with code/docs, and it is GNU.
Why rsync? It is GNU solution for syncing files.

Two basic session snippets for usage:

init files for directory:


cd fldr_for_sync 
mkdir RCS
# -- 
rcs -i file # add new file under rcs
# -- it is the same with --
touch another_file; ci anoter_file

basic rsync dir with subdirs; it is not overwrites old files in dest dir;
permissions and links kept;


rsync -avz path_to_fldr_src path_to_dest

I found that rcs + sync can substitute git for such task and even make the task more clear and robust, due to the long history and high stability of the rcs and rsync tools.

GUI vs. Command Line, similiarity in tools

2008-05-19T08:41:00.004+04:00

My first long-term job was Unix programming (in despite of fact that first money for code I got for Z-80 chip programming (some little hack of Z80 in beginning of 90'th )).

Thats way I prefer the command line tools.

I think GUI does not have real performance in tasks of programmer, also GUI skills can not be reused when you need automate your task you done before by clicking.

If you typed instead, you can put your typing in the script and make the script working for any count of times.

However I found in my practice some cases when GUI was better than command line for development.

1) Development of GUI
I have experience of the development of tools for the internet trading, that were mouse based and highly interactive. And visual tools for visual development were really much progress in comparison to writing code for forms definition. In such RAD tools for the GUI, GUI interface and the visual development environment is the must.

However, I know that for experienced traders command line tools were much more comfortable.
They used command line tools for trading instead of GUI, if they had the choice.

2) GUI for understanding new tool.
Visual GUI wrapper around CLI can be helpful when you are learning new tool.

Of cause output/actions log window in the CLI form is the must, to be able than do the actions from the command line.

3) GUI as wrapper around family of CLI tools, that are based on some concept, however using different syntax. For example, uniform interface around sccs/rcs/cvs/svn/git/ and so on,
helps you to avoid switching contest errors, when you have to maintain systems, based on different version control tools.

However, CLI wrapper would be even more helpful :)

Hybernate on CentOS5.1

2008-05-18T13:07:00.005+04:00

Found a way to hybernate (suspend to disk) through the xfce (and gnome) interface on CentOS5.1.
I don't see the hybernate button on the quit form (there only Logout, Restart and Shutdown).

Started

 gnome-power-preferences

and made settings:

Then got the icon in the tray through which it is possible to hybernate:

Pidgin encoding

2008-05-17T16:21:00.001+04:00

Set encoding to CP1251 in ICQ account preferences to make it working with russian encoding.

Todays issues

2008-05-17T15:30:00.002+04:00

1) Found that plugin-wrapper installed under firefox to support Adobe Flash
was not working under other user. I have seen no graphics in analytics and youtube.

After I written about:plugins in firefox address line, plugins started work.
Don't know how exactly they were "activated", but it works for me.

2) Written alias freemind for freemind.sh in my local folder.

3) currently installing;
pidgin (I am under xfce, and like pidgin on my eee pc)
squashfs
and other:

freemind on CentOS 5.1

2008-05-16T14:13:00.003+04:00

Required:
- Java from sun; installed from rpm with sun manual

export PATH=/usr/java/jre1.6.0_05/bin:$PATH
export JAVA_HOME="/usr/java/jre1.6.0_05"
export CLASSPATH=.:/usr/java/jdk1.6.0_05

Got zip freemind-max-bin from freemind sourceforge (ANY platform)
downloads page.

unzip in prepared folder in home;

chmod a+x freemind.sh
freemind.sh

also folder with unzipped freeminf could be added in the path.

Issues: no shortcuts working under xfce.
---
Update: It is working fine with full support of shortcuts under java jdk1.5.0_14

httrack for centOS x64

2008-05-15T23:02:00.006+04:00

httrack software solved me as the mirroring solution for Ubuntu.
Tryied get it on CentOS.
no .rpm found; downloaded tar.gz from httrack official site;


# tar -xf [tarfile]
# ./configure

configure: error: either specify a valid zlib installation with --with-zlib=DIR or disable zlib usage with --without-zlib

To resolve:

yum install zlib-devel
./configure
make all
make install

Ok than, I have it.

tried 'virtualization' under CentOS QEMU

2008-05-15T00:17:00.004+04:00

Just to try what is new in word of virtual machines ( In my opinion it is not long now :) )

No idea why it can be best solution for any of common tasks.

Used file for filesystem, non-xen kernel (due to still having no network on -xen with my card).

Extremely slow.
>30 minutes to load Xubuntu Gutsy in machine.
(2-3 minutes on low-end Asus eeePC).

Host is CentOS 5.1 AMD Opteron x64 machine. Target i686 500 mb memory eeeXubuntu (Xubuntu gutsy 7.10).

upd:CentOS 5.1 realtec 8168/8111b

2008-05-14T15:27:00.004+04:00

finally I have got it working under 'standard' (non-xen) kernel
using the guides from wolfy and wikipedia (http://wolfy.fedorapeople.org/) :

http://wiki.centos.org/HardwareList/RealTekRTL8111b
http://wolfy.fedorapeople.org/dkms-r8168/quick_install.html

However I still have no network under xen-kernel,
that is boring :(

CentOS(RHEL) and Suse difference from Ubuntu and Debian

2008-05-13T14:24:00.005+04:00

Basically all this systems are GNU/Linux systems.

The main difference from the point of desktop user is set of applications that already present on fresh install, default configuration of desktop (graphics and theme mainly) and kernel version used.

All these distributions support kernel upgrade (through update manager, and manually, through recompilation of kernel downloaded from kernel.org (but in different recommended way for this distro's; however, seems

make oldconfig; 
make all

works on all distro's).

Main way of installing applications on the distributions is installing from packages.

Debian (with Knoppix) and Ubuntu are .deb-based distributions, where .deb is extension of package on these systems.

RedHat (CentOS, Fedora) and Suse are .rpm based distributions. Package extension is .rpm.

Also these systems support user-friendly layer for installing applications.

For .deb-based distro's main tool is apt (also different graphical front-ends used), and for .rpm based such tool is yum.

Both yum and apt provide similar functionality, such as installing, removing and searching for package.

Thats way, if you are migrating from .deb to .rpm – based system or from .rpm to .deb following matching for commands have to be considered:

RPM       DEB
--------------------
yum  <-> apt, apt*
rpm  <-> dpkg

Look into the man's for details.

If we consider applications packaged for distro's, traditionally, Debian has more opensource applications packaged and considered to be fast, however .rpm based distro's (as RedHat) has more Enterpise-Level applications (for example Sybase ASE database engine doesn't work on new Ubuntu's due to incompatibility in glibc).

Also, software for clustering, virtualization, logical volume group management is installed from box on CentOS5.1 with GUI and documentation.

However, watching movie or using some new cheap desktop hardware can be a problem on CentOs or RedHat, when on fresh Ubuntu it will work from Box.

There some .rpm-based desktop distributions like Ferdora, or Mandriva that repositories could be used for fresh drivers for video card or some other hardware. These distributions are more friendly on user side.

For my hardware, I use CentOS 5.1 for AMD64 desk (sometimes it works as home server), and Xubuntu's on my Laptops (eeePc, and 15.4 ' laptop from HP).

I was happy with my Xubuntu's and installed CentOS just to play with Sybase, and other enterprise-eevel products that are not supported by vendors for Debian (and Ubuntu).

64bit flash plugin for firefox 1.5 under rpm-based distro (CentOS)

2008-05-13T00:26:00.003+04:00

Page that works in solving some issues, for installing plugin on 64-bit firefox 1.5 under CentOS 5.1 on my box:
http://www.linuxheadquarters.com/howto/64-bit/flash64.shtml

Google analytics however, not works pretty well with this plugin.

Use this article to get Flash and Java working.

CentOS 5.1 fglrx driver 1440x900 resolution get

2008-05-12T14:19:00.008+04:00

My lspci output:


rtg]# lspci 
00:00.0 Host bridge: ATI Technologies Inc RS690 Host Bridge
00:01.0 PCI bridge: ATI Technologies Inc RS690 PCI to PCI Bridge (Internal gfx)
00:07.0 PCI bridge: ATI Technologies Inc RS690 PCI to PCI Bridge (PCI Express Port 3)
00:12.0 SATA controller: ATI Technologies Inc SB600 Non-Raid-5 SATA
00:13.0 USB Controller: ATI Technologies Inc SB600 USB (OHCI0)
00:13.1 USB Controller: ATI Technologies Inc SB600 USB (OHCI1)
00:13.2 USB Controller: ATI Technologies Inc SB600 USB (OHCI2)
00:13.3 USB Controller: ATI Technologies Inc SB600 USB (OHCI3)
00:13.4 USB Controller: ATI Technologies Inc SB600 USB (OHCI4)
00:13.5 USB Controller: ATI Technologies Inc SB600 USB Controller (EHCI)
00:14.0 SMBus: ATI Technologies Inc SBx00 SMBus Controller (rev 14)
00:14.1 IDE interface: ATI Technologies Inc SB600 IDE
00:14.2 Audio device: ATI Technologies Inc SBx00 Azalia
00:14.3 ISA bridge: ATI Technologies Inc SB600 PCI to LPC Bridge
00:14.4 PCI bridge: ATI Technologies Inc SBx00 PCI to PCI Bridge
00:18.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration
00:18.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map
00:18.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller
00:18.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous Control
01:05.0 VGA compatible controller: ATI Technologies Inc RS690 [Radeon X1200 Series]
01:05.2 Audio device: ATI Technologies Inc Radeon X1200 Series Audio Controller
02:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 01)
03:07.0 FireWire (IEEE 1394): VIA Technologies, Inc. IEEE 1394 Host Controller (rev c0)

I decided to install ati drivers to make get 1440x900 resolution.

http://ati.amd.com/support/drivers/linux64/linux64-radeon.html

download,

chmod 755  ati*

from directory,

 ./ati-driver-installer-8-4-x86.x86_64.run

, and install starts.

It was not working from scratch, however I have got the solution for my VW195D panel.

It is sufficient, that refresh rate have to be 75 Mhz, not 60 Mhz.

output of

 gtf 1440 900 75

used for setting magic values in xorg.conf

here is my xorg.conf

It is still not working for the GNOME environment.

It is working for CentOS xfce and KDE, however it should wotk for other distro's like RedHat EL, Mandriva, Fedora, Debian, Ubuntu and so on...

Unzip tared and bzip'ed (.tar.bz2) file or folder

2008-05-09T23:10:00.005+04:00

'verbose' way:

tar vjxf file.tar.bz2

-or- 'quite' way:

tar jxf file.tar.bz2

CentOS5 fixing Realtec RTL 8111b ethernet adapter.

2008-05-09T21:48:00.012+04:00

following is partialy working solution
For working solution look at the end of post in green

Found page:

http://wiki.centos.org/HardwareList/RealTekRTL8111b

Thats way I hve to download some staff to install it on machine without internet.

I have used my laptop with Xubuntu 8.04 to download staff, and USB drive to move to machine with CentOS.

Copyied bz2 driver from link there (r8168-8.005.00.tar.bz2) to flash
and then on CentOS 5 machine.

no tar and bz2 in folder where it is copied, so


bzip2 -d *.bz2
tar -xf *.tar

-or-


tar vjxf r816*

made me folder with driver src.

less readme

tells that you should
1)

make clean modules

,
However, it is not working (errors reported, that pathes not exist)
because linux headers are not installed by default on system.

To resolve:
2) go there: http://mirror.centos.org/centos/5/os/x86_64/CentOS/
get

 

search kernel-xen-dev on page (ctrl-f in browser like firefox)

[] kernel-xen-devel-2.6.18-53.el5.x86_64.rpm  20-Nov-2007 21:27 4.9M

on USB drive, umount and connect drive to CentOS machine.

on CentOS: doubleclick on .rpm you downloaded, or

rpm -i /media/[disk-id]/kernel-xen-devel-2.6.18-53.el5.x86_64.rpm

3) Also you need to install in the way specified in 2) all packages specified on table in wiki link above.

further dependencies are following: (A <--B means B depends from A)

 kernel-headers <-- glibc-headers <-- glibc-devel <-- gcc

thats way you have install first kerenel-headers, and last gcc.

also gcc 4.1 required libgomp , so I have also downloaded it from page, and installed before gcc.

that return back to 1)
than (also following readme):


make install
depmod -a
insmod ./src/r8168.ko
ifconfig -a # to monitor
ifconfir eth0 up # eth0 listened in previous line

Thats all. you can start Mozilla ( 1.5 in CentOS ( LOL :)= ) )
and google this post :)

Update:

However, after reboot I got this driver listened in the Gnome network manager, but it imposible to activate it from GUI, or by ifconfig eth0 up.

So this solution is not complete for now.

I am going to compile custom Kernel, because it works with 2.6.22 kernel that was on Xubuntu 7.10 live/install CD.

Update 2:

I have fixed driver for the non-xen kernel:

Also Latest kernel (2.6.25) downloaded from kernel.org resolved problem.
With this kernel it works without any configuration.

Bought new desktop, installation of CentOS 5.0, first problems

2008-05-09T14:54:00.007+04:00

Bought Athlon 64 desk (<400 usd) and 19" wide monitor (~210 USD).
all on Asus hardware

Now CentOS 5.0 x64 is installing on it.

Installation is smooth, however very different from Debian based distributions.

By default selected all types from list (Desktop KDE, Desktop GUI, Server, Server GUI, Cluster ... )

Left some space on device for further playing with different file systems.

First problems:
a) It requires login and password of user on first boot , and I cannot switch from local encoding .
skip user addition (to install further).
b) No network after install on fresh machine.
(to compare,
Xubuntu 7.10 livecd detected network and internet without any effort)

In Gnome Network Preferences, no any adapter installed.

However it a lot of fun staff from the box (like sftp , and one virtual machine running).

Overall expression : Amazing thing, but need some work to make it working with such basic things as Internet.

USB socket

2008-05-08T15:16:00.004+04:00

USB socket in my laptop becomes bad.

Now I need to find position for mouse to make it working.
Don't want to go service , cause I need laptop now.

Stupid problem, but makes life worst :(

Going next time to buy hardware from another producer,
just because of the problem.

GL install for eeeXubuntu

2008-05-08T14:55:00.000+04:00

xorg.conf for 915resolution got from eeeusers forum not worked been intalled on eeexubuntu 7.10 v.3.

Found that it enables gl that is not installed from the scratch.

sudo apt-get install libgl1-mesa-dri libgl1-mesa-glx libglu1-mesa

solved the problem.

Than X server restarts well.

Just another database definition

2008-05-07T16:09:00.001+04:00

In fact, this is all you need to know to be a Caveman Database Programmer: A relational database is a big spreadsheet that several people can update simultaneously.

Firebug for firefox 3.0

2008-05-07T15:58:00.004+04:00

Firefox 3.0 is by default in Ubuntu Hardy 8.04 that is now on my laptop.

FF 3.0 has less memory leaks, however it is a lot of reasons to downgrade to 2.0 that is more functional in part of add-on's for now.

Update:
-------

found following page to get firebug for firefox 3:

http://getfirebug.com/releases/
search
Firefox 3.0
on page

Ugly ER notation

2008-05-07T15:25:00.004+04:00

Started day with reading Garcia, Ulman's and Widom book:
"Database Systems: The Complete Book" (2nd ed, Russian translation)

First of all looked through all, and found it very interesting in the details that met my eyes.

Also it has a very good descriptions of terminology generally used.

However the second chapter, passed is ugliest one. I haven't seen application that use notation proposed for years.

Week entities, round and common arrows, rhombuses, in what database applications they are used?
And a lot of "philosophy" there, that is description of a lot of correct and incorrect ways to present data in the model. And the 3rd chapter begins with statement that relational model is different from previous presented.

Ok, it seems that 2nd chapter could be passed without given a lot of attention to.

Resource related to the book:

http://infolab.stanford.edu/~ullman/fcdb/aut07/index.html#lecture

going to play a little with examples from there.

GL install for eeeXubuntu

2008-05-07T09:38:00.002+04:00

xorg.conf for 915resolution got from eeeusers forum not worked been installed on eeexubuntu 7.10 v.3.

Found that it enables gl that is not installed from the scratch.

sudo apt-get install libgl1-mesa-dri libgl1-mesa-glx libglu1-mesa

solved the problem.

Than X server with gl installed restarts well.

eeeXubuntu wlanon/wlanoff

2008-05-06T00:08:00.003+04:00

Way to turn on and turn off wlan from command line/ *sh script:

Used aliases (commands equivalents) for using from command line:
grep from profile:


$ cat .bashrc |grep alia
alias wlanon="sudo echo 1 > /proc/acpi/asus/wlan"
alias wlanoff="sudo echo 0 > /proc/acpi/asus/wlan"

usage:
wlanon
wlanoff

X11 hacking

2008-05-05T23:55:00.003+04:00

xev - displays information on events got by X windows (mouse move or keyboard press for example)

Example:


MotionNotify event, serial 31, synthetic NO, window 0x3a00001,
    root 0x59, subw 0x0, time 9142646, (124,15), root:(729,412),
    state 0x0, is_hint 0, same_screen YES

MotionNotify event, serial 31, synthetic NO, window 0x3a00001,
    root 0x59, subw 0x0, time 9142654, (126,9), root:(731,406),
    state 0x0, is_hint 0, same_screen YES

MotionNotify event, serial 31, synthetic NO, window 0x3a00001,
    root 0x59, subw 0x0, time 9142662, (128,3), root:(733,400),
    state 0x0, is_hint 0, same_screen YES

LeaveNotify event, serial 31, synthetic NO, window 0x3a00001,
    root 0x59, subw 0x0, time 9142670, (130,-3), root:(735,394),
    mode NotifyNormal, detail NotifyNonlinear, same_screen YES,
    focus YES, state 0
XIO:  fatal IO error 11 (Resource temporarily unavailable) on X server ":0.0"
      after 31 requests (31 known processed) with 0 events remaining.

look at the end of man xev for further reading.

Eeedora

2008-05-05T00:48:00.004+04:00

Finaly, combined previous two post I have got Eeedora working.

Livecd loaded much faster, than eeeXubuntu one.

It looks as fine pretender to be on ssd of Eee PC.

Haven't played with rpm's for 7 years, good oportunity
to remember :)

First impression - it is very fast in load.

make usb disk bootable

2008-05-04T23:03:00.001+04:00

parted /dev/sdb set 1 boot on

Tryied installing Eeedora by tutorial on eeeusers.

2008-05-04T21:48:00.009+04:00

Network failed to be fixed even with installed last atl2.ko module compiled on another laptop.

Thats way while it is not fixed decided to try another, rpm based distro, that is Eeedora (Fedora (RedHat based) based for eee).

followed there:
http://wiki.eeeuser.com/eeedora:installing


~$ sudo syslinux /dev/sdb1

Got it in zip, following eeeusers wiki , then simply unzipped it on flash drive.

inserted in nearest right USB slot, waiting.
Nothing appears.

Seems this manual broken also in this point (it is a lot little mistakes around),
it was no record about making this disk bootable.

Ok, thats way I will try it next time :) Now already returned back to eeeXubuntu 7.10 (rel3) that seems most used now (except of Xandros) distro for eee.

I'll play with it later :)

Unix usage tips blog

What this blog is about?

On cygwin

services

I provide:

Feel free to contact.

GNU/Linux: copy , organize and rename all files in directrory with new mask.

Clear space on blogger page

your text/list/links there

On testing.

3 unix tools for working with legacy code

chmod list of dirs (or files)

Fix network problems after upgrade laptop to Ubuntu 9.04 Jaunty Jackalope

Testing with complexity bookmarks:

ASN1C

Code reviews and luck of requirements

Strategy for legacy software system code redesign

Top searches in my blog up to the moment:

Freemind 0.9 - > flash problems

searching for free software:

reading:

current reading

Making algorithm for strings processing practical

Normalization of big tables by user

partitioning in Mysql limitation prevents some optimizations

DB Performance testing framework.

Compilation-based:

Interpretable:

Survivable long-living software systems.

Monitoring system bounds

Simple plotting with gnuplot

SVN: Load dump in

Join all avi files in one

current notes on net-snmp MIBs

nftw command line version

When minimalism is bad

Long "which" command form

My Ubuntu installation config variables:

SNMP monitoring resources list.

Freebsd 7.0 install on home box failed :(

Different signal handling under FreeBSD and Linux

ftw example for systems comparison.

bookmarks on books been read in different time and steel having value:

Signal delivery failed under FreeBSD.

freebsd biord in top

Planning

Last 3 monthes events

SVN commands + vim

simple malloc test for systems comparison

Just a little summary of tags in the head

eee pc ubuntu psx (playstation emulator)

eee pc ubuntu zsnes with sound

build autotools project with gcov support

Using autotools HOWTO

EPEL repository for CentOS 5

MySql basics CentOs 5

Minix3 book version under qemu

Databases; central table

Cygwin pthreads exit causes access violation example

ddd installation on centOS

Gcc auto-vectorization

CPP (C++) vs C, std::string vs char[] : string processing benchmark

Eject cd or DVD disk under Linux

stupid vs smart, case vs ftable, algorithms vs processors, testing price vs gain

atexit() example. exit (1) in main, but $?=0

c99 vectors, c++ example.

Gentoo install from liveCD

setjmp, longjmp second parameter

CentOS x64: firefox java and flash plugin

Last solutions of problems with x64 that worked:

Flash:

Below are the previous problem solutions that worked in different time

Java:

Flash

Solution 1:

Solution 2:

Installing eee Ubuntu 8.04

eeeXubuntu 7.10 update of the kernel to 22-15

mc : can not ftp on ftp://xxx.xxx.xxx.xxx address

Claws mail -> move mail (inbox and other folders) to card