dbms_job failed to execute 2005-10-27 - By Magnus Andersen
Igor,
I did check for broken jobs before I ran it manually. None of the jobs had
the flag set to Y. The only other trace files I have are generated from a
utl_smtp procedure that we have. Sometimes the end-users format the e-mail
addresses wrong and the job fails. That is all. This is a known issue that
I've asked the developers to fix and catch in the application before it
reaches the database.
Magnus
On 10/27/05, Igor Neyman <ineyman@(protected)> wrote:
>
> Magnus,
> Did you check dba_jobs before you run them manually this morning?
> Did you see "broken" jobs? When you run jobs manually, "broken" changes
> from Y to N.
> If yes - there supposed to be corresponding trace files in "udump"
> directory. Or look for more _j000_ or _j001_ and so on in bdump directory
> with the timestamps between Saturday and this morning.
> Igor
>
> -- ---- ---- ---- ---- ---- --
> *From:* Magnus Andersen [mailto:mag.andersen@(protected)]
> *Sent:* Thursday, October 27, 2005 11:04 AM
> *To:* Igor Neyman
> *Cc:* oracle-l@(protected)
> *Subject:* Re: dbms_job failed to execute
>
> Igor,
>
> The database only goes down Saturday mornings for cold backup. I'm doing
> hot backups the rest of the week. I'm thinking about changing this to only
> to hot backups since I've read that there is no reason to do the cold, but
> that is an other thread I might start to iron that out. My guess is that the
> problem started saturday, but I didn't catch the issue before Tuesday
> morning. The reason you see all the jobs executed this morning is that I had
> to run them manually. We have several processes that are depending on these
> procedures being run. They do not execute on their own.
>
> Hope this makes sense.
>
> Magnus
>
> On 10/27/05, Igor Neyman <ineyman@(protected)> wrote:
> >
> > Magnus,
> > When you are saying that jobs stopped executing on Tuesday, does it
> > mean that they were not executed since then?
> > Your output from dba_jobs shows that all your jobs were executed this
> > morning (probably when your instance was started) and they all are scheduled
> > to be executed tomorrow at different times (probably, as they are supposed
> > to).
> > The reason they all were executed this morning right after instance
> > started is that most probably your instance was down at the time when they
> > were scheduled to be executed, and when oracle starts, it checks if it
> > missed to execute some jobs while the instance was down.
> > And if it finds such jobs that "missed" their scheduled time, it will
> > execute them immediately (not waiting for next scheduled time).
> > HTH
> > Igor
> >
> > -- ---- ---- ---- ---- ---- --
> > *From:* oracle-l-bounce@(protected) [mailto:
> > oracle-l-bounce@(protected)] *On Behalf Of *Magnus Andersen
> > *Sent:* Thursday, October 27, 2005 10:17 AM
> > *Cc:* oracle-l@(protected)
> > *Subject:* Re: dbms_job failed to execute
> >
> > I found two trace files with the same time stamp on them. These are the
> > closest to when I saw the problem. Could this have "hung" since the database
> > bounced?
> >
> > --
> > Magnus Andersen
> > Systems Administrator / Oracle DBA
> > Walker & Associates, Inc.
> >
> >
> > Trace file information...
> >
> > Dump file /opt/oracle/ora92/rdbms/log /prd/bdump/prd_j000_9659.trc
> > Oracle9i Enterprise Edition Release 9.2.0.6.0 - Production
> > With the Partitioning, OLAP and Oracle Data Mining options
> > JServer Release 9.2.0.6.0 - Production
> > ORACLE_HOME = /opt/oracle/ora92
> > System name: Linux
> > Node name: oraprd.walkerassoc.com <http://oraprd.walkerassoc.com/>
> > Release: 2.4.21-32.0.1.ELsmp
> > Version: #1 SMP Tue May 17 17:52:23 EDT 2005
> > Machine: i686
> > Instance name: prd
> > Redo thread mounted by this instance: 1
> > Oracle process number: 28
> > Unix process pid: 9659, image: oracle@(protected) (J000)
> >
> > *** 2005-10-22 00:38:58.415
> > *** SESSION ID:(27.52095) 2005-10-22 00:38:58.391
> > OPIRIP: Uncaught error 1089. Error stack:
> > ORA-01089 (See ORA-01089.ora-code.com): immediate shutdown in progress - no operations are permitted
> > ORA-00448 (See ORA-00448.ora-code.com): normal completion of background process
> >
>
>
>
> --
> Magnus Andersen
> Systems Administrator / Oracle DBA
> Walker & Associates, Inc.
>
--
Magnus Andersen
Systems Administrator / Oracle DBA
Walker & Associates, Inc.
Igor,<br>
<br>
I did check for broken jobs before I ran it manually. None of the
jobs had the flag set to Y. The only other trace files I have are
generated from a utl_smtp procedure that we have. Sometimes the
end-users format the e-mail addresses wrong and the job fails.
That is all. This is a known issue that I've asked the developers
to fix and catch in the application before it reaches the
database. <br>
<br>
Magnus<br><br><div><span class="gmail_quote">On 10/27/05, <b class="gmail
_sendername">Igor Neyman</b> <<a href="mailto:ineyman@(protected)">ineyman
@(protected)</a>> wrote:</span><blockquote class="gmail_quote" style=
"border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding
-left: 1ex;">
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
>Magnus,</font></span></div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"><
/font></span> </div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
>Did you check dba_jobs before you run them manually this
morning?</font></span></div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
>Did you see "broken" jobs? When you run jobs
manually, "broken" changes from Y to N.</font></span></div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
>If yes - there supposed to be corresponding trace files in
"udump" directory. Or look for more _j000_ or _j001_ and so on
in bdump
directory with the timestamps between Saturday and this
morning.</font></span></div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"><
/font></span> </div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
>Igor</font></span></div><br>
<div align="left" dir="ltr" lang="en-us">
<hr>
<font face="Tahoma" size="2"><span class="q"><b>From:</b> Magnus Andersen
[mailto:<a href="mailto:mag.andersen@(protected)" target="_blank" onclick="return
top.js.OpenExtLink(window,event,this)">mag.andersen@(protected)</a>] <br></span>
<span class="q"><b>Sent:</b> Thursday, October 27, 2005
11:04 AM<br><b>To:</b> Igor Neyman<br></span><span class="q"><b>Cc:</b>
<a href="mailto:oracle-l@(protected)" target="_blank" onclick="return top.js
.OpenExtLink(window,event,this)">oracle-l@(protected)</a><br><b>Subject:</b>
Re: dbms_job failed to
execute<br></span></font><br></div>
<span class="q"><div></div>Igor,<br><br>The database only goes down Saturday
mornings for cold
backup. I'm doing hot backups the rest of the week. I'm thinking
about changing this to only to hot backups since I've read that there is no
reason to do the cold, but that is an other thread I might start to iron that
out. My guess is that the problem started saturday, but I didn't catch
the
issue before Tuesday morning. The reason you see all the jobs executed
this morning is that I had to run them manually. We have several
processes
that are depending on these procedures being run. They do not execute on
their own.<br><br>Hope this makes sense.<br><br>Magnus<br><br>
</span><div><span class="q"><span class="gmail_quote">On 10/27/05, <b class=
"gmail_sendername">Igor
Neyman</b> <<a href="mailto:ineyman@(protected)" target="_blank" onclick=
"return top.js.OpenExtLink(window,event,this)">ineyman@(protected)</a>>
wrote:</span>
</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204,
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><span class="q">
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
>Magnus,</font></span></div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
></font></span> </div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
>When you
are saying that jobs stopped executing on Tuesday, does it mean that they
were
not executed since then?</font></span></div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
>Your
output from dba_jobs shows that all your jobs were executed this morning
(probably when your instance was started) and they all are scheduled to be
executed tomorrow at different times (probably, as they are supposed
to).</font></span></div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
></font></span> </div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
>The reason
they all were executed this morning right after instance started is that most
probably your instance was down at the time when they were scheduled to be
executed, and when oracle starts, it checks if it missed to execute some jobs
while the instance was down.</font></span></div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
>And if it
finds such jobs that "missed" their scheduled time, it will execute
them
immediately (not waiting for next scheduled time).</font></span></div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
></font></span> </div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
>HTH</font></span></div>
<div align="left" dir="ltr"><span><font color="#0000ff" face="Arial" size="2"
>Igor</font></span></div><br>
</span><div align="left" dir="ltr" lang="en-us">
<hr>
<font face="Tahoma" size="2"><span class="q"><span><b>From:</b> <a href=
"mailto:oracle-l-bounce@(protected)" target="_blank" onclick="return top.js
.OpenExtLink(window,event,this)">oracle-l-bounce@(protected)</a> [mailto:
<a href="mailto:oracle-l-bounce@(protected)" target="_blank" onclick="return
top.js.OpenExtLink(window,event,this)">oracle-l-bounce@(protected)</a>] <b>On
Behalf Of </b>Magnus
Andersen<br></span></span><span class="q"><b>Sent:</b> Thursday, October 27,
2005 10:17
AM<br><b>Cc:</b> <a href="mailto:oracle-l@(protected)" target="_blank"
onclick="return top.js.OpenExtLink(window,event,this)">oracle-l@(protected)<
/a><br><b>Subject:</b> Re: dbms_job
failed to execute<br></span></font><br></div>
<div><span><span class="q">
<div></div>I found two trace files with the same time stamp on them.
These are the closest to when I saw the problem. Could this have "
;hung"
since the database bounced?</span><span><br clear="all"><span class="q"><br>-
- <br>Magnus
Andersen<br>Systems Administrator / Oracle DBA<br>Walker & Associates,
Inc.<br><br><br></span></span><span class="q">Trace file information...<br>
<br>Dump file
/opt/oracle/ora92/rdbms/log
<div>/prd/bdump/prd_j000_9659.trc<br>Oracle9i Enterprise Edition Release
9.2.0.6.0 - Production<br>With the Partitioning, OLAP and Oracle Data Mining
options<br>JServer Release 9.2.0.6.0 - Production<br>ORACLE_HOME =
/opt/oracle/ora92<br>System name: Linux<br>Node
name: <a href="http://oraprd.walkerassoc.com/"
target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">oraprd
.walkerassoc.com</a><br>Release:
2.4.21-32.0.1.ELsmp<br>Version: #1
SMP Tue May 17 17:52:23 EDT
2005<br>Machine: i686<br>Instance
name: prd<br>Redo thread mounted by this instance: 1<br>Oracle process number
:
28<br>Unix process pid: 9659, image: <a href="mailto:oracle@(protected)
.walkerassoc.com" target="_blank" onclick="return top.js.OpenExtLink(window
,event,this)">oracle@(protected)</a> (J000)<br><br>*** 2005-10-22
00:38:58.415<br>*** SESSION ID:(27.52095) 2005-10-22 00:38:58.391<br>OPIRIP:
Uncaught error 1089. Error stack:<br>ORA-01089 (See ORA-01089.ora-code.com): immediate shutdown in
progress
- no operations are permitted<br>ORA-00448 (See ORA-00448.ora-code.com): normal completion of background
process</div></span></span></div></blockquote></div><br><br clear="all"><br>-
- <div><span class="e" id="q_10732ab8cf401db3_20"><br>Magnus
Andersen<br>Systems Administrator / Oracle DBA<br>Walker & Associates, Inc.
</span></div></blockquote></div><br><br clear="all"><br>-- <br>Magnus Andersen
<br>Systems Administrator / Oracle DBA<br>Walker & Associates, Inc.
|
|
