Problem z etykietowaniem woluminów

Wysłane przez Mordimer 
Problem z etykietowaniem woluminów 10 sie 2017 - 09:53:21

Send PM

Witajcie
Czy mógłbym prosić o pomoc w diagnozie następującego problemu?
Mam w eksploatacji Baculę v 5.2.5 i coś mam źle zrobione w konfiguracji etykietowania w
woluminów i nie potrafię tego zidentyfikować.

Startuję z pierwszym jobem na poziomie FULL. Kończy on się wykonywać w połowie woluminu nr 17.
Startuje kolejny job – tym razem INCREMENTAL – i kontynuuje zapis do woluminu 17 – i na nim kończy
Kolejny backup INCREMENTAL – kończy się miejsce na woluminie 17 i system zamiast stworzyć i zaetykietować wolumin 18 próbuje kolejno etykietować woluminy od 1 do 17 (które już istnieją) a potem próbuje utworzyć wolumin 18 i wyrzuca błąd że plik nie istnieje. Proces się zatrzymuje w oczekiwaniu na zalabelowanie nowego woluminu.

Po odwołaniu tego joba kolejny już poprawnie tworzy wolumin 18 i kontynuuje wykonanie backupu.

Poniżej logi z opisanych zdarzeń i konfiguracja.




2017-08-08 04:18:25 	srv168001bcc005-dir JobId 11: Bacula srv168001bcc005-dir 5.2.5 (26Jan12):
Build OS: x86_64-pc-linux-gnu ubuntu 12.04
JobId: 11
Job: FIESTA_MonthlyBackup.2017-08-07_23.30.02_10
Backup Level: Full (upgraded from Incremental)
Client: "FIESTA-fd" 5.2.6 (21Feb12) x86_64-pc-linux-gnu,debian,7.0
FileSet: "FIESTA" 2017-08-07 23:30:03
Pool: "Pool02" (From Job resource)
Catalog: "Catalog_168001bcc005" (From Client resource)
Storage: "disk02-srv192168001bcc005" (From Pool resource)
Scheduled time: 07-Aug-2017 23:30:02
Start time: 07-Aug-2017 23:30:04
End time: 08-Aug-2017 04:18:25
Elapsed time: 4 hours 48 mins 21 secs
Priority: 100
FD Files Written: 469,990
SD Files Written: 469,990
FD Bytes Written: 181,006,655,992 (181.0 Gcool smiley
SD Bytes Written: 181,103,664,266 (181.1 Gcool smiley
Rate: 10462.2 KB/s
Software Compression: 37.4 %
VSS: no
Encryption: no
Accurate: no
Volume name(s): Pool02-00001|Pool02-00002|Pool02-00003|Pool02-00004|Pool02-00005|Pool02-00006|Pool02-00007|Pool02-00008|Pool02-00009|Pool02-00010|Pool02-00011|Pool02-00012|Pool02-00013|Pool02-00014|Pool02-00015|Pool02-00016|Pool02-00017
Volume Session Id: 7
Volume Session Time: 1502101332
Last Volume Bytes: 9,480,125,201 (9.480 Gcool smiley
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK

2017-08-08 23:30:58 	srv168001bcc005-dir JobId 19: Bacula srv168001bcc005-dir 5.2.5 (26Jan12):
Build OS: x86_64-pc-linux-gnu ubuntu 12.04
JobId: 19
Job: FIESTA_MonthlyBackup.2017-08-08_23.30.00_11
Backup Level: Incremental, since=2017-08-07 23:30:04
Client: "FIESTA-fd" 5.2.6 (21Feb12) x86_64-pc-linux-gnu,debian,7.0
FileSet: "FIESTA" 2017-08-07 23:30:03
Pool: "Pool02" (From Job resource)
Catalog: "Catalog_168001bcc005" (From Client resource)
Storage: "disk02-srv192168001bcc005" (From Pool resource)
Scheduled time: 08-Aug-2017 23:30:00
Start time: 08-Aug-2017 23:30:03
End time: 08-Aug-2017 23:30:58
Elapsed time: 55 secs
Priority: 100
FD Files Written: 384
SD Files Written: 384
FD Bytes Written: 230,140,142 (230.1 Mcool smiley
SD Bytes Written: 230,217,382 (230.2 Mcool smiley
Rate: 4184.4 KB/s
Software Compression: 59.5 %
VSS: no
Encryption: no
Accurate: no
Volume name(s): Pool02-00017
Volume Session Id: 14
Volume Session Time: 1502101332
Last Volume Bytes: 9,710,591,435 (9.710 Gcool smiley
Non-fatal FD errors: 0
SD Errors: 0
FD termination status: OK
SD termination status: OK
Termination: Backup OK

2017-08-09 23:30:02 	srv168001bcc005-dir JobId 26: Start Backup JobId 26, Job=FIESTA_MonthlyBackup.2017-08-09_23.30.00_21
2017-08-09 23:30:02 	srv168001bcc005-dir JobId 26: Using Device "BkpStor02"
2017-08-09 23:30:02 	srv168001bcc005-sd JobId 26: Volume "Pool02-00017" previously written, moving to end of data.
2017-08-09 23:30:02 	srv168001bcc005-sd JobId 26: Ready to append to end of Volume "Pool02-00017" size=9710591435
2017-08-09 23:31:44 	srv168001bcc005-dir JobId 26: Error: sql_create.c:424 Volume "Pool02-00002" already exists.
2017-08-09 23:31:44 	srv168001bcc005-sd JobId 26: Job FIESTA_MonthlyBackup.2017-08-09_23.30.00_21 is waiting. Cannot find any appendable volumes.
Please use the "label" command to create a new Volume for:
Storage: "BkpStor02" (/BkpStorage/BkpStor02)
Pool: Pool02
Media type: File
2017-08-09 23:31:44 	srv168001bcc005-sd JobId 26: User defined maximum volume capacity 10,737,418,240 exceeded on device "BkpStor02" (/BkpStorage/BkpStor02).
2017-08-09 23:31:44 	srv168001bcc005-sd JobId 26: End of medium on Volume "Pool02-00017" Bytes=10,737,364,395 Blocks=166,441 at 09-Aug-2017 23:31.
2017-08-09 23:31:44 	srv168001bcc005-dir JobId 26: Error: sql_create.c:424 Volume "Pool02-00001" already exists.
2017-08-09 23:36:44 	srv168001bcc005-dir JobId 26: Error: sql_create.c:424 Volume "Pool02-00003" already exists.
..... 
2017-08-10 00:26:46 	srv168001bcc005-dir JobId 26: Error: sql_create.c:424 Volume "Pool02-00013" already exists.
2017-08-10 00:31:46 	srv168001bcc005-sd JobId 26: Job FIESTA_MonthlyBackup.2017-08-09_23.30.00_21 is waiting. Cannot find any appendable volumes.
Please use the "label" command to create a new Volume for:
Storage: "BkpStor02" (/BkpStorage/BkpStor02)
Pool: Pool02
Media type: File
2017-08-10 00:31:46 	srv168001bcc005-dir JobId 26: Error: sql_create.c:424 Volume "Pool02-00014" already exists.
2017-08-10 00:36:46 	srv168001bcc005-dir JobId 26: Error: sql_create.c:424 Volume "Pool02-00015" already exists.
2017-08-10 00:41:46 	srv168001bcc005-dir JobId 26: Error: sql_create.c:424 Volume "Pool02-00016" already exists.
2017-08-10 00:46:46 	srv168001bcc005-dir JobId 26: Error: sql_create.c:424 Volume "Pool02-00017" already exists.
2017-08-10 00:51:46 	srv168001bcc005-sd JobId 26: Warning: mount.c:217 Open device "BkpStor02" (/BkpStorage/BkpStor02) Volume "Pool02-00018" failed: ERR=dev.c:562 Could not open: /BkpStorage/BkpStor02/Pool02-00018, ERR=No such file or directory

2017-08-10 00:51:46 	srv168001bcc005-dir JobId 26: Created new Volume "Pool02-00018" in catalog.
2017-08-10 00:51:46 	srv168001bcc005-sd JobId 26: Warning: mount.c:217 Open device "BkpStor02" (/BkpStorage/BkpStor02) Volume "Pool02-00018" failed: ERR=dev.c:562 Could not open: /BkpStorage/BkpStor02/Pool02-00018, ERR=No such file or directory

2017-08-10 00:51:46 	srv168001bcc005-sd JobId 26: Warning: mount.c:217 Open device "BkpStor02" (/BkpStorage/BkpStor02) Volume "Pool02-00018" failed: ERR=dev.c:562 Could not open: /BkpStorage/BkpStor02/Pool02-00018, ERR=No such file or directory

.....
.....
2017-08-10 07:51:46 	srv168001bcc005-sd JobId 26: Warning: mount.c:217 Open device "BkpStor02" (/BkpStorage/BkpStor02) Volume "Pool02-00018" failed: ERR=dev.c:562 Could not open: /BkpStorage/BkpStor02/Pool02-00018, ERR=No such file or directory

2017-08-10 07:56:46 	srv168001bcc005-sd JobId 26: Warning: mount.c:217 Open device "BkpStor02" (/BkpStorage/BkpStor02) Volume "Pool02-00018" failed: ERR=dev.c:562 Could not open: /BkpStorage/BkpStor02/Pool02-00018, ERR=No such file or directory

2017-08-10 08:01:46 	srv168001bcc005-sd JobId 26: Warning: mount.c:217 Open device "BkpStor02" (/BkpStorage/BkpStor02) Volume "Pool02-00018" failed: ERR=dev.c:562 Could not open: /BkpStorage/BkpStor02/Pool02-00018, ERR=No such file or directory

2017-08-10 08:05:44 	srv168001bcc005-dir JobId 26: Fatal error: No Job status returned from FD.
2017-08-10 08:05:44 	srv168001bcc005-dir JobId 26: Fatal error: Network error with FD during Backup: ERR=Interrupted system call
2017-08-10 08:05:44 	srv168001bcc005-sd JobId 26: Fatal error: Job 26 canceled.
2017-08-10 08:05:44 	srv168001bcc005-sd JobId 26: Job write elapsed time = 08:35:42, Transfer rate = 33.15 K Bytes/second
2017-08-10 08:05:44 	srv168001bcc005-dir JobId 26: Bacula srv168001bcc005-dir 5.2.5 (26Jan12):
Build OS: x86_64-pc-linux-gnu ubuntu 12.04
JobId: 26
Job: FIESTA_MonthlyBackup.2017-08-09_23.30.00_21
Backup Level: Incremental, since=2017-08-08 23:30:03
Client: "FIESTA-fd" 5.2.6 (21Feb12) x86_64-pc-linux-gnu,debian,7.0
FileSet: "FIESTA" 2017-08-07 23:30:03
Pool: "Pool02" (From Job resource)
Catalog: "Catalog_168001bcc005" (From Client resource)
Storage: "disk02-srv192168001bcc005" (From Pool resource)
Scheduled time: 09-Aug-2017 23:30:00
Start time: 09-Aug-2017 23:30:02
End time: 10-Aug-2017 08:05:44
Elapsed time: 8 hours 35 mins 42 secs
Priority: 100
FD Files Written: 0
SD Files Written: 0
FD Bytes Written: 0 (0 cool smiley
SD Bytes Written: 0 (0 cool smiley
Rate: 0.0 KB/s
Software Compression: None
VSS: no
Encryption: no
Accurate: no
Volume name(s): Pool02-00017
Volume Session Id: 19
Volume Session Time: 1502101332
Last Volume Bytes: 0 (0 cool smiley
Non-fatal FD errors: 17
SD Errors: 0
FD termination status: Error
SD termination status: Canceled
Termination: Backup Canceled

bacula-dir.conf
#  Bacula Director Configuration file
#  For Bacula release 5.2.5 (26 January 2012) -- ubuntu 12.04

############## DIRECTOR CONF ############## 
Director {                            
  Name = srv168001bcc005-dir
  DIRport = 9101                
  QueryFile = "/etc/bacula/scripts/query.sql"
  WorkingDirectory = "/var/lib/bacula"
  PidDirectory = "/var/run/bacula"
  Maximum Concurrent Jobs = 5
  Password = "vOchjaYxGgFnKdbE5me5a3Tp5vs763FyoIhXdqUF733A"         # Console password
  Messages = Daemon
  DirAddress = 192.168.1.5
  Statistics Retention = 3 years
}

############## CATALOG CONF ############## 
Catalog {
  Name = Catalog_168001bcc005
# Uncomment the following line if you want the dbi driver
# dbdriver = "dbi:sqlite3"; dbaddress = 127.0.0.1; dbport =  
  dbname = "bacula"; DB Address = ""; dbuser = "bacula"; dbpassword = "#xxxxxxxxxxxxxxxxxx#"
}

############## STORAGE DEVICE CONF ############## 
Storage {
  Name = disk02-srv192168001bcc005
# Do not use "localhost" here    
  Address = 192.168.1.5
  SDPort = 9103
  Password = "8dSaFXDGr9d_ZvW9SyMKX-Dwx7j4jpjGF"
  Device = BkpStor02
  Media Type = File
}

Storage {
  Name = disk03-maniana
# Do not use "localhost" here    
  Address = 192.168.128.20
  SDPort = 9103
  Password = "8dSaFXDGr9d_ZvW9SyMKX-Dwx7j4jpjGF"
  Device = BkpStor03
  Media Type = File
}

############## COUNTERS CONF ##############

Counter {
  Name = Counter00
  Minimum = 1
  Maximum = 10000
}

Counter {
  Name = Counter01
  Minimum = 1
  Maximum = 10000
}

Counter {
  Name = Counter02
  Minimum = 1
  Maximum = 10000
}

Counter {
  Name = Counter03
  Minimum = 1
  Maximum = 10000
}


############## POOLS CONF ##############

Pool {
  Name = Pool02
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 42 days
  Maximum Volume Bytes = 10G
  Action On Purge = Truncate
  LabelFormat = "Pool02-${Counter02+:p/5/0/r}"
  Maximum Volumes = 260
  Storage = disk02-srv192168001bcc005
}

Pool {
  Name = Pool03
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 180 days
  Maximum Volume Bytes = 10G
  Action On Purge = Truncate
  LabelFormat = "Pool03-${Counter03+:p/5/0/r}"
  Maximum Volumes = 190
  Storage = disk03-maniana
}


############## SCHEDULES CONF ##############
Schedule {
  Name = "MonthlyCycle04"
  Run = Full 1st fri at 22:00
  Run = Incremental mon-sun at 23:30
}


############## JOBDEFS CONF ##############

JobDefs {
  Name = "standard-backup"    #normal backup job
  Type = Backup
  Level = Incremental
#  Storage = disk01-srv192168001bcc005    #normal backup storage
  Messages = Standard
  Pool = Pool01     #normal backup pool
  Priority = 100
  Write Bootstrap = "/BkpStorage/BootStrapFiles/%c.bsr"
  Rerun Failed Levels = yes
}


############## CLIENTS CONF ##############
Client {
  Name = FIESTA-fd
  Address = 192.168.1.15
  FDPort = 9102
  Catalog = Catalog_168001bcc005
  Password = "SQQ-2DDOc7fM-ZqHntbTx_t6vjC-_Edc_"
  File Retention = 42 days
  Job Retention = 42 days
  AutoPrune = yes                     # Prune expired Jobs/Files
}


############## FILESET CONF ##############


FileSet {
  Name = "FIESTA"
  Include {
    Options {
      signature = MD5
      compression = GZIP
      noatime=yes
      xattrsupport=yes
      aclsupport=yes
      onefs=yes
    }

#   File = "/media/73d0adad-cad8-4490-aef1-b92019499162/ARCHIWUM"
    File = "/media/73d0adad-cad8-4490-aef1-b92019499162/cmms"
    File = "/media/73d0adad-cad8-4490-aef1-b92019499162/CNC_obrabiarki"
    File = "/media/73d0adad-cad8-4490-aef1-b92019499162/COMMON"
    File = "/media/73d0adad-cad8-4490-aef1-b92019499162/DIRECTOR"
    File = "/media/73d0adad-cad8-4490-aef1-b92019499162/FINANCE"
    File = "/media/73d0adad-cad8-4490-aef1-b92019499162/HR"

  }
}



############## JOBS CONF ##############
######################## ADMIN JOBS  ############################
#..
######################## RESTORE JOBS ############################

Job {
  Name = "RestoreJob"
  Type = Restore
  Client = RZE_APP8R2-fd
  FileSet = RZE_APP8R2-TETA
  Storage = disk00-srv192168001bcc005
  Pool = Pool00
  Messages = Standard
  Where = "/bacula-restore"
}

####################### BACKUP JOBS ###########################


Job {
  Name = "FIESTA_MonthlyBackup"
  JobDefs = "standard-backup"
  Pool = Pool02
  Schedule = "MonthlyCycle04"
  Client = FIESTA-fd
  FileSet = "FIESTA"
}

Pozdrawiam i dziękuję
Irek
Re: Problem z etykietowaniem woluminów 10 sie 2017 - 19:52:15

Send PM

Ciekaw jestem czy problem był jednorazowy, czy występuje ciągle? Jeśli jednorazowy, to problemem zapewne był aktualny status środowiska i użycie liczników (Counter). Osobiście unikam używania liczników (z tego co pamiętam, to są plany aby je całkowicie usunąć z funkcjonalności, ale teraz nie mogę znaleźć odpowiedniego maila od Kerna - Może @gani będzie wiedział coś więcej w tym temacie) i "wysublimowanych" zmiennych w Label Format. Taka konfiguracja nie ma żadnych zalet i jak do tej pory nikt, kto chciał lub tego używał, nie był w stanie podać jakiejkolwiek obiektywnej zalety, poza ja tak chcę lub tak mi się podoba.

--
Profesjonalne usługi Bacula: [www.bacula.com.pl]
Re: Problem z etykietowaniem woluminów 11 sie 2017 - 07:22:17

Send PM

Powtarza się - z reguły po backupach typu full - ale nie zawsze. Niestety nie zauważyłem żadnych zależności.
Liczniki zastosowałem bo wcześniej też były jakieś problemy z etykietowaniem i myślałem że liczniki pozwolą mi ich uniknąć. Niestety było to dosyć dawno i nie pamiętam szczegółów ani nie mam logów.
Pewnie wyrzucę te liczniki i zobaczymy co dalej.
Dziękuję.
Przykro nam, ale tylko zarejestrowane osoby mogą pisać na tym forum.

Kliknij żeby zalogować