shell script help for users

cmontr · 11-14-2007, 10:08 PM

Hello guys, I would appreciate if someone can help me for this task:

I have a large txt file that contains lots of user ids in different format. I need to run this against a database output ldif file and print to a file whether they exist or not. And if they exist then I need to print their information from the ldif file. I appreciate in advance if anyone can assist.

THe user file looks like ( a chunk of it ):

060606ab
12345678910
110maryland
123thebestfather
1superman1
22221111333_1234567

And the ldif file ( a section of it ) looks like:

dn: uid=MYFILE1,ou=someou,o=test.com
21tCGX2RdpxnkaJU0mI/BC0jdaBBbUt8gjnRxAhMU2
authpassword;orclsomepwd: {ABC}a2F4=
businesscategory: SomeCategory
createtimestamp: 2007070911234z
creatorsname: cn=someload
modifiersname: cn=someoad
modifytimestamp: 20070709181203z
objectclass: top
objectclass: someUser
orclguid: ABCDFF4AD107
orclnormdn: uid=myid1,ou=someconsumer,o=vz.com
pwdchangedtime: 20070709181203z
uid: MYFILE1
userpassword: ABCDRFGEmBXrHCKZa2F4=
canswer: Hello
cinkid: MYFILE1
cquestion: What is my mother's maiden name
cusergroup: somecustomer
cuserstatus: 0

Actually if a uid in the txt file exist in the ldif file, I want to print dn, cquestion, and userstatus

server information: sun os 5.9
it has perl version 5.6.1

any script/program such as shell script, perl script using awk/sed/etc would help me a lot, I appreciate ...

chrism01 · 11-14-2007, 10:48 PM

This would be easy in Perl:

I'd go with building a hash to store the ldif info, but each entry would only contain the uid, dn, cquestion, and userstatus, keyed on uid.
Then read through the user file in a loop and do

Code:

if( exists( $ldif{$uid} ) )
{
    print "$uid $ldif{'dn'} $ldi{'cq'} $ldif{'status'}\n";
}

how well do you know Perl.?

bigearsbilly · 11-15-2007, 03:02 AM

need more clues,
the users are each on a line, like 123thebestfather, 1superman1 etc?

is the uid in idfile uid:? (MYFILE1)
a more complete ldif file would be something to work with.

do we get paid

cmontr · 11-15-2007, 04:14 AM

Quote:

Originally Posted by bigearsbilly

need more clues,
the users are each on a line, like 123thebestfather, 1superman1 etc?

is the uid in idfile uid:? (MYFILE1)
a more complete ldif file would be something to work with.

do we get paid

Hi - Yes uid's are like you said but there are many of them in a text file. The questions is that that text file contains uid's are in the ldif file or not... For exaple, if one of the uid is found, then print the values such as dn. if not found, print elsewhere etc. Thank you very much.

bigearsbilly · 11-15-2007, 05:28 AM

we don't mind helping, but we'd want some more data to play with,
a ldif file with a few users entries would be nice.

cmontr · 11-15-2007, 08:10 AM

Hi, please see the sample ldif file with 3 entries in it...in real server it is like 15GB. Thank you very much again...

dn: uid=test1,ou=someconsumer,o=abc.com
canswer: 111111111
cuserstatus: 0
uid: test1
businesscategory: SomeConsumer
objectclass: top
objectclass: SomeUser
clinkid: test1
userpassword: password1
cusergroup: regularcustomer
cquestion: what is your father's name?

dn: uid=test2,ou=someconsumer,o=abc.com
canswer: 22222222
cuserstatus: 1
uid: test1
businesscategory: SomeConsumer
objectclass: top
objectclass: SomeUser
clinkid: test1
userpassword: password1
cusergroup: regularcustomer
cquestion: In what City did/do your parents live?

dn: uid=test3,ou=someconsumer,o=abc.com
canswer: 33333333
cuserstatus: 2
uid: test1
businesscategory: SomeConsumer
objectclass: top
objectclass: SomeUser
clinkid: test1
userpassword: password1
cusergroup: regularcustomer
cquestion: In what City did/do your parents live?

bigearsbilly · 11-15-2007, 08:33 AM

FIFTEEN Gig !!!!!!

well we won't bother slurping that file into a big hash then

(agreed chrism?)

cmontr · 11-15-2007, 08:36 AM

it is s big db...i meant 15 MB apoligies.... typed it wrong...

bigearsbilly · 11-15-2007, 08:49 AM

phew,
well, you could slurp that away maybe.

If I were you i would consider using at minimum a DBM file to store it all,
then you could easily look it up.

does anything else use this file?
how many searches do you make,
1 a day?
200 a minute?

bigearsbilly · 11-15-2007, 09:42 AM

Here's a quick and dirty go,
not fully robust
multiple fields like objectclass:
will get mashed together in the wash

does regex match (if you prefer), and will match multiple names on the command line

Code:

#!/usr/bin/perl -s

my $db_name = "database";  # change this bit

local $/ = "";          # paragraph mode
local $\ = "\n";        # print terminator

open DATABASE, "<$db_name" or die "cannot open $db_name:$!\n";
@ARGV or die "search for who?\n";;

while (<DATABASE>) {

    $debug and print "=" x 30, "\n";    # -debug switch

    @L = split /(\w+):\s*/;     # split on colon fields
    shift @L;                   # first field is null, lose it
    chomp @L;

    $debug and print "@L";

    $H = { @L };                # convert to a hash


    foreach $uid (@ARGV) {

        # UNCOMMENT TO ALLOW AN EXACT MATCH ONLY
        # next unless $H->{uid} eq $uid;

        # this is a regex match (not shell patterns)
        next unless $H->{uid} =+ m/$uid/;

        # choose your fields
        print "=" x 30;
        print $H->{dn};
        print $H->{cquestion};
        print $H->{userstatus};
    }

}

Code:

./1.pl ROG test3
==============================
uid=ROGER,ou=someconsumer,o=abc.com
what is your father's name?

==============================
uid=test3,ou=someconsumer,o=abc.com
In what City did/do your parents live?

cmontr · 11-15-2007, 10:23 AM

Would you please clear something for me?

How could I store txt and ldif in a dbm file ? The need is to look for uids given in txt in the ldif file, then if they exist print the info like dn etc...

I tried modifying the line "my $db_name = "test.txt"; # change this bit" however I couldnt get it running yet. I have 2 files whioh one contains uid's list, and the other is the ldif file. Would you please tell me where to modify this perl script in order to get it running? Thank you very much.

chrism01 · 11-15-2007, 05:09 PM

Actually BB, I meant read the ldif file line by line as normal, and (as I said) ONLY store the relevant fields, which would cut down the amt of data dramatically. Even a 15 GB file would prob shrink enough. Could always use a Tied hash if it's too big.

BTW:
next unless $H->{uid} =+ m/$uid/;
shouldn't that be
next unless $H->{uid} =~ m/$uid/;
you did say regex