*SPAM* Re: submission/search problems on demo site

["Stuart L. Marshall" <marshall@xxxxxxxxxxxxxxxxx>]

Hi,

More news and some progress.

-------------------------------------------------------------------
Summary:

Demo site installed and visible.  JPEG file uploaded but it does
not show up in the search page, nor does the number of records
increase from 152 to 153 as it should.  However, the file is
accessible vi the URL given in the autogenerated email from the
upload process.

-------------------------------------------------------------------
In more detail:


First, I did find a problem with php in that the php.ini file
did not have the line:

   extension=mysql.so

(It did for the apache version but not the cli).

That fixed, I did a removal and re-install as suggested and
was able to get the "make load-demo-records" to run correctly.
(I forgot, I think I needed to change the second line of
the bibupload php script from:
   <?
   to
   <?php

That made it stop failing immediately and dumping the contents of the
script to stderr.

So that put 152 records into the site and they are visible for browsing
etc.  I guess all the actual links to documents are really to cern
but that is okay.

Next I uploaded a jpeg file and got this email:

   ----------------------------------------------------------------
   Date: Wed, 20 Jul 2005 11:31:23 -0700
   Subject: PICTURE-TEST-DIAG-2005-001: Document Received

   The document PICTURE-TEST-DIAG-2005-001
   Title: FKB Construction Camera View
   Author(s): Marshall, S.

   has been correctly received

   It will be soon added to our Document Server.

   Once inserted, you will be able to check the  bibliographic
   information and the quality of the electronic documents at this URL:
   <http://xxx.stanford.edu/cds/search.py?recid=153> If you detect an
   error please let us know by sending an email to
   root@xxxxxxxxxxxxxxxxx
	  
   Thank you for using KIPAC Document Server Test Installation
   Submission +Interface.
   ----------------------------------------------------------------

which indicates my picture should be record #153.  The output of


I am running bibsched -d and the interactive interface shows:

ID   PROC       USER                 RUNTIME              SLEEP  STATUS     PROG
---  ----       ----                 -------------------  -----  -----      ----
231  webcoll    root@xxxxxxxxxxxxxxxxxxxxxxxxxxxx 11:28:39  10m    WAITING    No
221  bibindex   root@xxxxxxxxxxxxxxxxxxxxxxxxxxxx 11:40:28  1h     WAITING    No
222  bibrank    root@xxxxxxxxxxxxxxxxxxxxxxxxxxxx 11:40:29  1h     WAITING    No
224  bibreformatroot@xxxxxxxxxxxxxxxxxxxxxxxxxxxx 11:40:36  1h     WAITING    No
        
so I am running webcoll every 10 minutes and the others every hour.


Running:

   echo "SELECT id,proc,runtime,status,progress FROM schTASK;" | bin/dbexec

shows:

   id      proc    runtime status  progress
   1       bibupload       2005-07-20 11:05:32     DONE    Done 76 out of 76.
   2       bibindex        2005-07-20 11:05:38     DONE    idxWORD10F flush ended
   3       bibreformat     2005-07-20 11:08:03     DONE    NULL
   4       bibupload       2005-07-20 11:08:15     DONE    Done 0 out of 0
   5       webcoll 2005-07-20 11:08:15     DONE    Done.
   6       bibrank 2005-07-20 11:08:23     DONE    rnkWORD01F flush ended
   7       bibupload       2005-07-20 11:31:23     DONE    Done 1 out of 1.
   8       bibindex        2005-07-20 11:36:45     DONE    idxWORD10F flush ended
   9       bibindex        2005-07-20 12:36:56     DONE    NULL
   10      bibreformat     2005-07-20 11:37:07     DONE    NULL
   11      bibupload       2005-07-20 11:37:15     DONE    Done 0 out of 0
   12      bibreformat     2005-07-20 12:37:15     DONE    NULL
   13      webcoll 2005-07-20 11:37:33     DONE    Done.
   14      webcoll 2005-07-20 11:47:41     DONE    Done.
   15      bibrank 2005-07-20 11:37:55     DONE    rnkWORD01F flush ended
   16      bibrank 2005-07-20 12:38:06     DONE    NULL
   17      webcoll 2005-07-20 11:57:41     DONE    Done.
   18      webcoll 2005-07-20 12:07:41     DONE    Done.
   19      webcoll 2005-07-20 12:10:12     DONE    Done.
   ...

You can see the original demo site upload as id #1 ?

The bibupload task #7 appeared to run.

As suggested in the "Document Receieved" email, if I go to the URL
<http://xxx.stanford.edu/cds/search.py?recid=153 I get access to the
picture and all is nice:

   FKB Construction Camera View

   Marshall, S. ;

   2005-07-20

   Abstract: View of Fred Kavli Building construction from
   http://www-group.slac.stanford.edu/kipac/kicam.html.

   Keyword(s):KIPAC ; construction ; webcam ;

   Access to Fulltext:
   http://xxx.stanford.edu/cds/getfile.py?recid=153

   Record created 2005-07-20, last modified 2005-07-21


However, when I go to the regular search page it still only shows
152 records and I can't find the picture w/out knowing it is there
already.

So some additional step is needed to make the record # 153 visible.

Thanks very much for all the help so far and I hope just a little
more is needed to get it really running.

Stuart



Quoting Tibor Simko (tibor.simko@xxxxxxx) on Wed, Jul 20, 2005 at 10:02:20AM +0200:
> Hello Stuart
>
> On Tue, 19 Jul 2005, Stuart L. Marshall wrote:
> > Perhaps I should start by mentioning that I on did
> > "make create-demo-site" and did NOT do: "make load-demo-records".
> >
> > I'm trying to create a site with just our records but I suppose I
> > could load the demos and then delete them later?
>
> Yes, via ``make remove-demo-records''.  This step is good to make sure
> that all your prerequisites work as they should.  If you have not done
> many local customizations, then it may be worth to clean everything
> and start anew like this:
>
>    $ rm -rf /prefix/var/*
>    $ make install && make drop-tables && make create-tables && >      make create-demo-site && make load-demo-records
>
> and then try to submit something.
>
> After you are happy with testing, you can clean it up the same way,
> just omit the last ``make load-demo-records''.
>
> (But maybe it's not needed if you check your PHP first.  See below.)
>
> > So I did that but there is no bibupload scheduled.
>
> It should have been scheduled by the WebSubmit when the submission
> process finished.  Anything interesting in the Apache error log?
>
> >   "echo "SELECT id,proc,runtime,status,progress FROM schTASK where
> >    proc='bibupload';" | /prefix/bin/dbexec"
> >
> > yields nothing.
>
> This means that the bibupload task was indeed not scheduled by the
> WebSubmit.
>
> A guess: is your PHP CLI compiled with pcntl, as indicated by the
> INSTALL guide?  Check it out like this:
>
>    $ php -r 'echo phpinfo();' | grep pcntl
>
> or check if you can see bibupload's help:
>
>    $ bibupload -h
>
> If pcntl is not enabled, then you should recompile your PHP as
> indicated in the INSTALL guide under item g).  For example:
>
>    $ ./configure --prefix=/soft/php >                  --with-mysql=/soft/mysql >                  --with-apxs2=/soft/httpd/bin/apxs >                  --enable-ftp --with-zlib --enable-pcntl >                  --enable-exif --with-ldap
>
> Please make sure that your mod_php is compiled against the same MySQL
> library as your mod_python.  We saw various troubles in the Apache
> context when they weren't.
>
> > In /usr/local/cds/var/tmp I've got files like:
> >   -rw-r--r-- 1 www-data www-data 1390 Jul 13 12:37
> >    TEST-ARTICLE-2005-001_2005-07-13_12:37:19
> >
> > which appears to be the xml data for the submission.
>
> Is the content good?  What happens if you run:
>
>    $ bibupload -i -r /path/to/TEST-ARTICLE-2005-001_2005-07-13_12:37:19
>
> > The area you mention is empty:
> >    # ls data/submit/storage/running/*
>
> Try rather:
>
>    $ ls -lR data/submit/storage/
>
> Tibor

--
- Stuart Marshall       650 926 3616                Office
- KIPAC/SLAC M/S 29         926 4310                Dept Office
- 2575 Sand Hill Rd.        926 8570                FAX
- Menlo Park, CA 94025  marshall@xxxxxxxxxxxxxxxxx  E-mail